-- Logs begin at Thu 2022-06-02 12:54:47 UTC, end at Thu 2022-06-02 14:20:37 UTC. -- Jun 02 13:44:02.117945 dv-cinder-826510-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 02 13:44:02.126769 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 02 13:44:02.128836 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 13:44:02 2022] *** Jun 02 13:44:02.128836 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 13:44:02.128836 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 13:44:02.128836 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: nodename: dv-cinder-826510-6-iscsi Jun 02 13:44:02.128836 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: machine: x86_64 Jun 02 13:44:02.128836 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: clock source: unix Jun 02 13:44:02.128836 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: pcre jit disabled Jun 02 13:44:02.128836 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: detected number of CPU cores: 4 Jun 02 13:44:02.128836 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: current working directory: / Jun 02 13:44:02.128836 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: detected binary path: /usr/bin/uwsgi-core Jun 02 13:44:02.128836 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: your processes number limit is 47680 Jun 02 13:44:02.129572 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: your memory page size is 4096 bytes Jun 02 13:44:02.129572 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: detected max file descriptor number: 2048 Jun 02 13:44:02.129572 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: lock engine: pthread robust mutexes Jun 02 13:44:02.129572 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: thunder lock: enabled Jun 02 13:44:02.129572 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 02 13:44:02.129572 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 13:44:02.173600 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: Python main interpreter initialized at 0x5558bfce89c0 Jun 02 13:44:02.173600 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: python threads support enabled Jun 02 13:44:02.173600 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: your server socket listen backlog is limited to 100 connections Jun 02 13:44:02.173600 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: your mercy for graceful operations on workers is 90 seconds Jun 02 13:44:02.173968 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 13:44:02.174047 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: *** Operational MODE: preforking *** Jun 02 13:44:02.174272 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: *** uWSGI is running in multiple interpreter mode *** Jun 02 13:44:02.174272 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: spawned uWSGI master process (pid: 103848) Jun 02 13:44:02.174462 dv-cinder-826510-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 02 13:44:02.175044 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: spawned uWSGI worker 1 (pid: 103849, cores: 1) Jun 02 13:44:02.175369 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: spawned uWSGI worker 2 (pid: 103850, cores: 1) Jun 02 13:44:02.175558 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 13:44:03.420799 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 13:44:03.448113 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 13:44:04.151000 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:44:04.151000 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: from cryptography.utils import int_from_bytes Jun 02 13:44:04.151376 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:44:04.151376 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: from cryptography.utils import int_from_bytes Jun 02 13:44:04.157144 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:44:04.157144 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: from cryptography.utils import int_from_bytes Jun 02 13:44:04.157490 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:44:04.157490 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: from cryptography.utils import int_from_bytes Jun 02 13:44:06.754734 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:44:06.755270 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:44:06.755359 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:44:06.755359 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:44:06.755752 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:44:06.755823 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:44:06.755901 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:44:06.756028 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:44:06.756165 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:44:06.756437 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.756542 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:44:06.756771 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.756880 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.757095 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.757193 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.757416 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.757507 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.758306 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.758404 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.758630 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.758719 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.758943 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.759041 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.759263 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.759352 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.759581 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.759667 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.759843 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.759940 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.760159 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.760263 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.760498 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.760589 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826510-6-iscsi {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.760827 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.760922 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826510-6-iscsi {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.761138 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.761232 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.761442 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.761535 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.761759 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.761846 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.762068 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.762189 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.762368 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.762464 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.762682 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.762769 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.762985 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.763185 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.763492 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.763674 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.763797 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.763908 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.764102 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.764220 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.764423 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.764586 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.764787 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.764923 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.765094 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.765215 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.765402 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.765538 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.765720 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.765847 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.766028 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.766175 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.766352 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.766485 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.766662 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.766887 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826510-6-iscsi {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.767053 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826510-6-iscsi {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.767207 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.767368 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.767521 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.767680 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.767836 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.767992 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.768252 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.768432 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.768622 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.768748 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.768912 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.769060 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.769189 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.769347 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.769508 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.769671 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.769818 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.769979 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.770144 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.770308 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.770463 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.770646 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.770783 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.770948 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.771103 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.771268 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.771406 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.771575 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.771716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.771884 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.772015 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.772191 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.772328 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.772535 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.772654 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.772841 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.772960 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.773145 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.773869 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.774119 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.774345 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.774443 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.774668 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.774794 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.775005 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.775115 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.775315 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.775414 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.775569 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.775669 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.775887 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.775985 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.776141 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.776236 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.776493 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.776615 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.776815 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.776917 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.777121 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.777207 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.777428 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.777514 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.777734 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.777829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.778042 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.778152 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.778346 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.778431 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.778651 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.778744 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.778958 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.779051 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.779273 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.779600 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.779940 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.780111 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.780314 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.780641 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.780808 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.780998 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.781202 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.781329 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.781515 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.781609 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.781835 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.781930 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.782142 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.782229 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.782478 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.782624 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.782786 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.782879 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.783095 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.783182 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.783400 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.783520 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.783706 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.783850 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.784026 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.784162 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.784348 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.784521 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.784676 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.784850 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.784937 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.785163 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.785260 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.785468 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.785553 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.785779 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.785865 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.786101 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.786187 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.786405 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.786490 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.786710 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.786797 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.786961 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.787045 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.787263 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.787347 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.787570 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.787664 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.787885 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.787970 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.788207 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.788315 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.788520 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.788621 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.788860 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.788956 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.789170 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.789393 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.789499 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.789712 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.789803 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.790023 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.790118 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.790335 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.790431 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.790645 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.790738 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.790954 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.791040 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.791257 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.791346 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.791563 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.791649 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.791869 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.791955 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.792174 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.792267 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.792503 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.792619 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.792829 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.792946 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.793136 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.793263 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.793441 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.793572 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.793763 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.793883 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.794071 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.794189 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.794380 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.794510 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.794700 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.794817 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.795001 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.795126 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.795317 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.795449 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.795634 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.795756 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.795954 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.796082 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.796252 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.796367 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.796578 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.796702 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.796883 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.797011 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.797187 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.797332 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.797492 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.797634 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.797795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.797941 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.798099 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.798261 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.798400 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.798569 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.798717 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.798875 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.799041 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.799176 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.799352 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.799480 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.799659 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.799783 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.799962 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.800086 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.800284 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.800377 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.800643 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.800730 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.800975 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.801077 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.801296 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.801382 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.801618 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.801702 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.801927 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.802011 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.802236 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.802322 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.802543 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.802629 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.802863 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:44:06.802959 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.803177 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.803269 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.803504 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.803596 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.803817 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.803913 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.804128 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.804213 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.804520 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.804625 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.804860 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.804998 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.805416 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.805521 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.805667 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.805752 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.805989 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.806077 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.806322 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.806408 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.806636 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.806759 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.806949 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.807049 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.807263 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.807350 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.807584 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.807670 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.807903 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.808005 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.808213 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.808298 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.808574 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.808664 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.808895 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.808983 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.809216 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.809311 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.809528 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.809614 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.809845 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.809932 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.810156 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.810241 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.810469 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.810556 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.810780 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.810873 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.811103 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.811188 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.811440 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.811525 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.811752 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.811837 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.812069 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.812153 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.812384 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.812594 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.812722 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.812807 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.813031 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.813116 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.813344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.813440 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.813660 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.813746 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.813994 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.814079 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.814305 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.814403 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.814619 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.814704 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.814930 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.815015 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.815243 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.815336 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.815559 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.815675 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.815869 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.815967 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.816179 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.816275 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.816510 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.816610 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.816819 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.816969 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.817126 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.817216 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.817436 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.817524 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.817739 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.817833 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.818053 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.818140 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.818366 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.818454 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.818670 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.818756 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.818973 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.819068 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.819279 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.819366 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.819586 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.819674 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.819893 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.819997 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.820831 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.820924 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.821206 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.821308 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.821566 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.821654 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.821875 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.821963 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.822182 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.822278 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.822504 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.822609 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.822818 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.822906 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.823126 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.823222 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.823437 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.823526 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.823746 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.823833 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.824056 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.824154 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.824364 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.824485 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.824700 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.824796 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.825018 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.825108 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.825328 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.825414 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.825634 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.825734 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.825956 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.826046 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.826266 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.826354 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.826574 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.826663 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.826890 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.826987 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.827203 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.827292 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.827520 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.827606 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.827832 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.827920 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.828145 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.828233 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.828497 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.828602 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.828804 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.828891 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.829118 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.829207 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.829426 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.829523 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.829732 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.829827 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.830037 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.830127 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.830348 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.830446 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.830653 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.830741 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.830959 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.831047 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.831264 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.831361 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.831568 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.831656 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.831873 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.831960 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.832180 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.832269 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.832510 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.832601 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.832816 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.832902 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.833119 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.833213 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.833420 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.833549 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.833730 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.833817 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.834034 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.834130 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.834339 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.834434 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.834663 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.834757 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.834974 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.835064 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.835280 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.835369 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.835586 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.836793 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.836887 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.836980 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.837202 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.837330 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.837514 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.837657 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.837862 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.837978 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.838202 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.838299 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.838526 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.838625 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.838854 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.838942 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.839170 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.839266 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.839488 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.839590 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.839804 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.839918 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.840116 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.840208 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.840459 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.840637 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.840788 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.840948 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.841095 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.841240 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.841396 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.841541 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.841695 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.841841 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.841986 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.842132 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.842290 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.842437 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.842583 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.842736 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.842902 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.843056 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.843282 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.843438 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.843585 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.843731 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.843889 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.844036 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.844218 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.844366 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.844549 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.844697 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.844843 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.845009 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.845156 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.845302 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.845447 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.845601 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.845748 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.845903 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.846204 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.846359 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.846359 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.846638 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.846638 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.846935 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.847083 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.847229 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.847229 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.847506 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.847651 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.847806 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.847954 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.848099 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.848251 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.848437 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.848604 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.848753 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.848918 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.849066 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.849212 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.849365 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.849520 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.849667 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.849667 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.849956 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.850103 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.850248 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.850408 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.850554 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.850700 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.850862 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.851009 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.851163 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.851354 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.851555 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.851713 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.851860 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.851860 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.852194 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.852348 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.852519 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.852609 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.852733 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.852822 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.853051 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.853150 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.853364 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.853453 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.853680 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.853768 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.853988 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.854076 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.854307 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.854466 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.854613 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.854758 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.854930 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.855078 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.855224 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.855380 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.855527 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.855681 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.855828 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.855973 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.856209 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.856368 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.856579 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.856736 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.856901 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.857048 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.857048 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.857324 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.857477 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.857637 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.857783 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.857928 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.858073 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.858219 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.858363 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.858526 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.858672 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.858833 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.858985 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.859131 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.859276 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.859438 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.859590 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.859743 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.859889 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.860043 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.860202 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.860356 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.860524 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.860684 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.860684 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.860981 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.861164 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.861313 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.861460 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.861606 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.861760 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.861906 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.862060 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.862234 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.862381 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.862534 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.862688 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.862852 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.863008 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.863155 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.863301 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.863446 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.863591 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.863752 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.863899 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.864044 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.864044 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.864320 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.864511 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.864683 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.864839 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.864986 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.865138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.865284 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.865430 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.865585 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.865732 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.865878 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.866031 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.866178 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.866361 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.866522 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.866679 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.866835 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.867058 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.867240 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.867396 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.867544 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.867699 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.867845 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.867992 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.868139 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.868285 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.868519 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.868682 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.868842 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.868989 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.869149 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.869306 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.869460 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.869610 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.869765 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.869911 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.870066 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.870213 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.870360 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.870515 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.870682 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.870829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.870975 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.871129 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.871283 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.871438 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.871584 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.871729 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.871875 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.872020 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.872173 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.872328 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.872513 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.872685 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.872839 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.872986 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.873140 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.873300 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.873454 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.873600 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.873754 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.873900 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.874054 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.874209 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.874356 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.874509 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.874678 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.874825 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.874980 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.875127 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.875282 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.875428 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.875574 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.875739 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.875896 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.876043 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.876190 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.876336 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.876506 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.876680 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.876837 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.876992 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.877138 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.877283 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.877431 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.877585 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.877731 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.877884 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.878038 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.878184 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.878337 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.878502 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.878658 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.878811 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.878958 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.879111 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.879258 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.879419 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.879571 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.879717 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.879863 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.880015 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.880171 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.880326 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.880528 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.880694 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.880842 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.880988 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.881152 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.881300 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.881445 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.881592 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.881737 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.881890 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.882045 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.882191 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.882345 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.882503 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.883168 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.883323 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.883479 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.883627 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.883779 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.883779 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.884058 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.884212 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.884359 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.884518 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.884625 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.884708 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.884788 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.884884 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.884969 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.885148 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.885247 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.885474 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.885563 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.885790 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.885888 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.886097 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.886186 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.886418 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.886528 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.886765 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.886913 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.887049 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.887187 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.887323 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.887472 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.887616 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.887751 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.887916 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.888052 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.888233 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.888381 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.888563 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.888653 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.888874 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.888962 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.889178 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.889280 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.889482 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.889570 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.889785 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.889872 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.890094 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.890200 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.890396 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.890485 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.890699 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.890787 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.891003 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.891093 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.891307 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.891608 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.891701 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.891912 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.892002 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.892222 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.892311 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.892549 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.892641 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.892856 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.892945 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.893160 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.893247 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.893507 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.893595 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.893815 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.893905 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.894164 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.894260 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.894471 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.894568 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.894777 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.894871 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.895086 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.895176 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.895393 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.895577 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.895714 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.895840 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.896002 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.896179 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.896315 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.896478 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.896643 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.896769 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.896939 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.897076 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.897254 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.897394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.897561 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.897691 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.897866 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.897996 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.898252 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.898871 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.899199 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.899432 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.899561 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.899686 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.899821 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.899960 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.900116 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.900248 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.900447 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.900579 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.900758 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.900890 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.901068 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.901197 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.901383 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.901514 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.901694 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.901825 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.902005 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.902145 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.902316 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.902446 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.902629 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.902761 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.902938 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.903067 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.903248 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.903455 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.903585 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.903710 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.903836 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.903961 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.904146 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.904290 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.904459 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.904586 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.904778 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.904926 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.905081 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.905218 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.905391 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.905519 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.905701 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.905837 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.906010 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.906149 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.906313 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.906442 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.906616 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.906745 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.906922 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.907050 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.907223 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.907352 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.907545 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.907673 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.907856 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.907993 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.908160 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.908298 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.908492 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.908624 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.908800 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.908939 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.909112 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.909241 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.909418 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.909548 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.909770 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.909900 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.910078 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.910215 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.910448 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.910657 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.910793 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.910921 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.911046 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.911180 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.911347 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.911490 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.911662 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.911792 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.911975 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.912103 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.912278 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.912437 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.912626 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.912754 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.912935 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.913077 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.913244 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.913384 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.913551 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.913689 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.913925 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.914179 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.914316 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.914453 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.914580 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.914705 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.914902 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.915033 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.915210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.915341 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.915517 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.915650 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.915820 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.916040 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.916186 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.916353 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.916507 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.916692 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.916816 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.917019 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.917163 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.917343 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.917474 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.917668 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.917799 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.917976 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.918179 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.918311 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.918493 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.918630 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.918805 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.918944 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.919134 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.919279 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.919459 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.919590 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.919784 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.919915 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.920088 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.920226 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.920397 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.920563 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.920729 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.920859 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.921043 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.921252 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.921383 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.921509 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.921666 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.921802 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.921980 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.922119 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.922285 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.922416 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.922616 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.922754 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.922937 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.923068 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.923248 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.923379 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.923572 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.923701 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.923881 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.924012 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.924187 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.924318 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.924517 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.924649 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.924844 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.924983 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.925150 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.925281 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.925463 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.925587 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.925779 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.925910 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.926084 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.926214 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.926388 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.926528 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.926695 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.926830 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.927018 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.927137 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.927320 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.927457 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.927631 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.927761 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.927943 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.928071 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.928248 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.928384 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.928580 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.928712 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.928887 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.929018 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.929209 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.929347 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.929550 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.929695 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.929832 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.929967 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.930143 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.930275 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.930466 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.930596 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.930788 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.930927 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.931093 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.931224 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.931415 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.931545 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.931724 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.931856 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.932030 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.932161 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.932340 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.932504 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.932672 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.932803 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.933016 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.933147 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.933321 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.933459 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.933642 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.933781 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.933972 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.934103 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.934274 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.934404 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.934581 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.934721 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.934894 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.935026 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.935202 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.935332 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.935509 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.935648 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.935823 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.935953 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.936132 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.936262 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.936464 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.936611 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.936767 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.936896 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.937071 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.937209 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.937374 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.937503 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.937680 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.937810 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.937987 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.938117 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.938296 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.938425 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.938598 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.938726 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.938901 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.939037 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.939202 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.939332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.939528 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.939658 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.939834 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.939964 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.940159 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.940291 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.940493 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.940625 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.940801 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.940945 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.941109 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.941239 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.941413 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.941553 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.941738 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.941875 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.942056 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.942185 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.942370 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.942499 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.942687 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.942835 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.943005 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.943134 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.943319 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.943448 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.943632 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.943770 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.943948 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.944076 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.944261 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.944392 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.944604 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.944741 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.944920 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.945589 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.945849 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.945981 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.946315 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.946444 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.946640 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.946770 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.946963 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.947101 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.947280 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.947410 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.947600 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.947729 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.947919 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.948047 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.948231 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.948359 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.948570 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.948781 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.948913 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.949115 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.949245 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.949431 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.949569 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.949748 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.949885 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.950063 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.950193 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.950383 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.950521 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.950701 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.950832 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.951040 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.951176 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.951303 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.951429 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.951615 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.951755 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.951931 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.952062 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.952263 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.952432 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.952616 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.952761 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.952924 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.953060 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.953242 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.953372 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.953560 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.953691 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.953877 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.954008 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.954190 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.954319 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.954500 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.954638 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.954815 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.954945 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.955128 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.955271 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.955442 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.955580 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.955753 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.955883 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.956067 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.956204 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.956380 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.956545 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.956719 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.956850 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.957035 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.957175 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.957351 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.957490 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.957662 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.957790 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.957971 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.958111 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.958282 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.958413 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.958597 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.958799 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.958939 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.959114 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.959246 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.959449 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.959587 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.959779 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.959918 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.960107 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.960238 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.960445 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.960595 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.961685 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.961926 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.962058 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.962329 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.962467 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.962639 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.962778 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.962954 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.963115 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.963268 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.963450 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.963588 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.963783 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.963914 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.964109 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.964241 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.964455 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.964588 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.964794 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.964934 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.965107 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.965244 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.965419 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.965638 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.965778 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.965995 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.966125 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.966313 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.966446 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.966636 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.966766 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.966948 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.967079 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.967255 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.967393 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.967560 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.967690 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.967873 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.968001 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.968181 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.968452 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.968602 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.968782 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.968913 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.969100 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.969231 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.969404 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.969546 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.969711 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.969842 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.970023 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.970153 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.970333 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.970465 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.970637 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.970768 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.970945 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.971083 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.971250 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.971379 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.971569 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.971693 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.971873 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.972002 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.972176 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.972314 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.972500 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.972630 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.972817 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.972961 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.973119 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.973256 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.973421 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.973559 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.973724 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.973864 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.974027 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.974156 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.974336 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.974465 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.974641 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.974780 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.974944 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.975073 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.975245 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.975381 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.975556 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.975693 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.975863 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.975995 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.976169 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.976316 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.976645 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.976778 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.976980 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.977087 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.977290 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.977457 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.977596 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.977852 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.978146 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.978301 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.978456 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.978894 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.979456 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.979600 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.980019 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.980597 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.980967 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.981887 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.982249 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.982401 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.982587 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.982741 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.982939 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.983087 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.983316 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.983892 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.984318 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.984483 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.984708 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.984879 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.985045 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.985140 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.985377 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.985468 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.985716 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.985814 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.986045 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.986225 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.986387 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.986475 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.986705 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.986802 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.987027 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.987114 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.987346 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.987433 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.987664 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.987771 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.987984 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.988237 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.988325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.988610 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.988713 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.988936 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.989030 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.989253 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.989341 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.989574 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.989671 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.989904 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.989999 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.990220 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.990308 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.990533 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.990630 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.990851 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.990939 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.991166 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.991261 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.991480 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.991567 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.991792 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.991900 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.992156 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.992253 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.992664 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.992753 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.992964 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.993052 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.993280 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.993367 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.993596 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.993685 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.993911 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.993998 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.994225 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.994327 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.994629 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.994716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.994950 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.995044 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.995262 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.995362 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.995579 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.995675 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.995911 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.995996 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.996294 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.996434 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.996575 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.996662 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.996903 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.996991 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.997220 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.997317 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.997539 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.997624 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.997854 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.997940 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.998167 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.998259 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.998481 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.998568 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.998801 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.998888 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.999107 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.999197 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.999416 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.999512 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.999731 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:06.999828 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.000057 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.000146 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.000372 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.000492 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.000707 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.000808 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.001016 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.001109 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.001328 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.001416 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.001637 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.001738 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.001945 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.002032 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.002253 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.002348 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.002562 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.002658 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.002873 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.002959 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.003179 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.003266 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.003486 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.003574 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.003792 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.003879 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.004098 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.004213 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.004422 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.004548 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.004782 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.004876 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.005047 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.005143 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.005354 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.005443 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.005661 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.005748 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.005970 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.006066 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.006278 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.006365 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.006585 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.006681 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.006921 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.007017 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.007234 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.007320 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.008085 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.008271 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.008469 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.008711 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.008804 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.008893 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.009081 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.009169 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.009387 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.009485 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.009696 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.009783 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.010003 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.010089 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.010310 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.010399 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.010619 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.010706 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.010927 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.011014 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.011239 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.011327 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.011546 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.011634 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.011855 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.011942 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.012161 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.012250 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.012490 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.012597 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.012800 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.012890 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.013131 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.013226 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.013463 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.013550 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.013775 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.013870 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.014097 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.014183 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.014413 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.014500 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.014732 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.014892 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.015040 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.015126 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.015352 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.015438 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.015673 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.015768 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.015988 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.016083 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.016300 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.016387 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.016644 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.016743 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.016960 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.017048 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.017276 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.017366 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.017589 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.017676 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.017901 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.017996 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.018223 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.018322 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.018518 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.018607 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.018837 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.018924 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.019163 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.019248 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.019472 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.019560 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.019799 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.019894 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.020121 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.020222 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.020463 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.020554 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.020784 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.020872 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.021101 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.021206 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.021415 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.021502 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.021725 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.021813 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.021971 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:44:07.022073 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.022338 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.022651 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.022965 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.023858 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.024162 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.024513 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.024844 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.025156 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.025484 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.025812 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.026163 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.026480 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.026823 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.027160 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.027475 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.027790 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.028098 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:44:07.028346 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:44:07.080452 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO dbcounter [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] Registered counter for database nova_api Jun 02 13:44:07.086997 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO dbcounter [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] Registered counter for database nova_api Jun 02 13:44:07.102307 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_db.sqlalchemy.engines [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:44:07.106630 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG oslo_db.sqlalchemy.engines [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:44:07.109681 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writer thread running {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:44:07.113840 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writer thread running {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:44:07.167623 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.context [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b23e70ef-c1f8-4cdc-b345-bb99123a3df5(cell1) {{(pid=103849) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 13:44:07.171812 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:07.173406 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:07.173534 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.context [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b23e70ef-c1f8-4cdc-b345-bb99123a3df5(cell1) {{(pid=103850) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 13:44:07.174232 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:07.176197 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:07.177753 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG oslo_concurrency.lockutils [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:07.178216 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO dbcounter [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] Registered counter for database nova_cell0 Jun 02 13:44:07.179301 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG oslo_concurrency.lockutils [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:07.180648 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG oslo_concurrency.lockutils [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:07.182617 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG oslo_concurrency.lockutils [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:07.182896 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO dbcounter [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] Registered counter for database nova_cell1 Jun 02 13:44:07.184626 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO dbcounter [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] Registered counter for database nova_cell0 Jun 02 13:44:07.188624 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO dbcounter [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] Registered counter for database nova_cell1 Jun 02 13:44:07.190598 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_db.sqlalchemy.engines [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:44:07.194488 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_db.sqlalchemy.engines [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:44:07.195897 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG oslo_db.sqlalchemy.engines [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:44:07.198421 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG oslo_db.sqlalchemy.engines [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:44:07.199294 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writer thread running {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:44:07.201396 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writer thread running {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:44:07.203347 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writer thread running {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:44:07.205988 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writer thread running {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:44:07.352121 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO dbcounter [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] Registered counter for database nova_cell0 Jun 02 13:44:07.354832 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO dbcounter [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] Registered counter for database nova_cell0 Jun 02 13:44:07.360873 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_db.sqlalchemy.engines [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:44:07.364316 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG oslo_db.sqlalchemy.engines [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:44:07.365263 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writer thread running {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:44:07.369306 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writer thread running {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:44:07.943417 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: WARNING keystonemiddleware.auth_token [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:44:07.951047 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: WARNING keystonemiddleware.auth_token [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:44:07.964062 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: WARNING keystonemiddleware.auth_token [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:44:07.971328 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: WARNING keystonemiddleware.auth_token [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:44:08.175930 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: WARNING keystonemiddleware.auth_token [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:44:08.182062 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: WARNING keystonemiddleware.auth_token [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:44:08.187163 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5558bfce89c0 pid: 103849 (default app) Jun 02 13:44:08.189553 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:08.190707 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001973 Jun 02 13:44:08.191112 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Thu Jun 2 13:44:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:08.196051 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: WARNING keystonemiddleware.auth_token [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:44:08.201541 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: WARNING keystonemiddleware.auth_token [None req-a1d6f851-3f49-4e04-ac6d-01676cdf27dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:44:08.206687 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5558bfce89c0 pid: 103850 (default app) Jun 02 13:45:32.504338 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:32.506029 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Jun 02 13:45:32.512214 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 2 13:45:32 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:32.519799 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writing DB stats nova_api:SELECT=3 {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:32.525142 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writing DB stats nova_cell0:SELECT=3 {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:32.525142 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writing DB stats nova_cell1:SELECT=3 {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:32.525142 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:32.963465 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-c1c38a4a-7b40-4473-907a-07feda64318b admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:32.994223 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-c1c38a4a-7b40-4473-907a-07feda64318b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.479463 Jun 02 13:45:33.009058 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 2 13:45:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:35.359352 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:35.360347 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-2333c2fb-f435-4534-9bf4-e6667bfee499 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jun 02 13:45:35.360776 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 2 13:45:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:35.421895 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-3051ce80-558f-414b-9d38-514e377f217b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:35.443374 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:45:35.443374 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: warnings.warn(msg) Jun 02 13:45:35.556146 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-3051ce80-558f-414b-9d38-514e377f217b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.188534 Jun 02 13:45:35.556919 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 2 13:45:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:45:35.570194 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_api:SELECT=3 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:35.570906 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_cell0:SELECT=3 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:35.571763 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_cell1:SELECT=3 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:35.572547 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:35.795753 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-aa419a45-bb69-4db6-96b6-ce9133953c34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:35.798256 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:45:35.798256 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: warnings.warn(msg) Jun 02 13:45:35.949526 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-aa419a45-bb69-4db6-96b6-ce9133953c34 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.384698 Jun 02 13:45:35.964439 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 2 13:45:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:45:38.329611 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-3051ce80-558f-414b-9d38-514e377f217b admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:38.330556 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-3051ce80-558f-414b-9d38-514e377f217b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 02 13:45:38.330955 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 2 13:45:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:38.440166 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-abe7d0c2-02eb-4e9b-9b10-c17975861bca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "ram": 512, "swap": 0, "disk": 5, "rxtx_factor": 1.0}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:38.458547 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:45:38.458547 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: warnings.warn(msg) Jun 02 13:45:38.598786 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-abe7d0c2-02eb-4e9b-9b10-c17975861bca admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.260311 Jun 02 13:45:38.599394 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 2 13:45:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:45:38.611461 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-24c2b328-e696-43e9-a5d4-a0143962d542 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:38.613112 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:45:38.613112 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: warnings.warn(msg) Jun 02 13:45:38.734407 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-24c2b328-e696-43e9-a5d4-a0143962d542 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126818 Jun 02 13:45:38.735268 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 2 13:45:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:45:41.049847 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-abe7d0c2-02eb-4e9b-9b10-c17975861bca admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:41.050880 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-abe7d0c2-02eb-4e9b-9b10-c17975861bca admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 02 13:45:41.051852 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 2 13:45:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:41.116597 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-7ab8eef1-b649-4bac-ad18-17d0b79f4dd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "disk": 10}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:41.228113 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-7ab8eef1-b649-4bac-ad18-17d0b79f4dd2 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.170252 Jun 02 13:45:41.228803 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 2 13:45:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:45:41.241996 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-2beb0999-558f-4adb-b92c-a0b4a41b5bab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:41.361901 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-2beb0999-558f-4adb-b92c-a0b4a41b5bab admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124382 Jun 02 13:45:41.362650 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 2 13:45:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:43.702776 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-7ab8eef1-b649-4bac-ad18-17d0b79f4dd2 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:43.703791 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-7ab8eef1-b649-4bac-ad18-17d0b79f4dd2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 02 13:45:43.704211 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 2 13:45:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:43.768231 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-e69a5773-65d4-48f9-a0c7-10689eeeb08c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "swap": 0}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:43.847923 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-e69a5773-65d4-48f9-a0c7-10689eeeb08c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136227 Jun 02 13:45:43.849007 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 2 13:45:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:45:43.861407 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-e7ee0d20-8c9c-4e1f-8cd6-134f27d98a80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:43.990101 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-e7ee0d20-8c9c-4e1f-8cd6-134f27d98a80 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132358 Jun 02 13:45:43.990683 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 2 13:45:43 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:46.312786 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-e69a5773-65d4-48f9-a0c7-10689eeeb08c admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:46.313797 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-e69a5773-65d4-48f9-a0c7-10689eeeb08c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jun 02 13:45:46.317658 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 2 13:45:46 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:46.373406 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-6c7af4d3-bb78-4b58-b842-7435bb02fc5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "swap": 0, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:46.466535 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-6c7af4d3-bb78-4b58-b842-7435bb02fc5b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146039 Jun 02 13:45:46.467248 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 2 13:45:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:45:46.479885 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-6d113d89-c554-40be-9157-3c5d4d89c4e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:46.577407 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-6d113d89-c554-40be-9157-3c5d4d89c4e4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101164 Jun 02 13:45:46.578095 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 2 13:45:46 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:48.914988 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-6c7af4d3-bb78-4b58-b842-7435bb02fc5b admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:48.916010 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-6c7af4d3-bb78-4b58-b842-7435bb02fc5b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 02 13:45:48.916440 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 2 13:45:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:48.976989 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-d08696f9-4792-4b17-87ad-fb43edd8c595 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:49.002125 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-d08696f9-4792-4b17-87ad-fb43edd8c595 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079419 Jun 02 13:45:49.003013 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 2 13:45:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:45:51.370864 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-6c7af4d3-bb78-4b58-b842-7435bb02fc5b admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:51.372110 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-6c7af4d3-bb78-4b58-b842-7435bb02fc5b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001911 Jun 02 13:45:51.372689 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 2 13:45:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:51.438465 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-b535d536-1ba5-4ef7-8ec5-818c8fcad3c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "id": "1", "ram": 512, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:51.517760 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-b535d536-1ba5-4ef7-8ec5-818c8fcad3c2 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.139016 Jun 02 13:45:51.518601 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 2 13:45:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:45:51.534599 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-778ca024-655f-45c5-a680-2d7c49b127cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:51.623659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-778ca024-655f-45c5-a680-2d7c49b127cf admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092709 Jun 02 13:45:51.624436 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 2 13:45:51 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:54.018780 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-b535d536-1ba5-4ef7-8ec5-818c8fcad3c2 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:54.019856 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-b535d536-1ba5-4ef7-8ec5-818c8fcad3c2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jun 02 13:45:54.020261 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 2 13:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:54.080112 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-f86101c5-d7c8-48c1-bd12-f164e225aeee admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small", "vcpus": 1, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:54.557796 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-f86101c5-d7c8-48c1-bd12-f164e225aeee admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.531648 Jun 02 13:45:54.558278 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 2 13:45:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:45:54.570866 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-7d10cbd3-7eb8-45ce-99cb-42367f6e5fd6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:54.692340 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-7d10cbd3-7eb8-45ce-99cb-42367f6e5fd6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125718 Jun 02 13:45:54.692967 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 2 13:45:54 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:45:57.413259 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-f86101c5-d7c8-48c1-bd12-f164e225aeee admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:57.414269 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-f86101c5-d7c8-48c1-bd12-f164e225aeee admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 02 13:45:57.414673 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 2 13:45:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:57.474680 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-a945a5b3-be1e-4113-b893-7ebdc5a3f965 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2, "id": "3", "os-flavor-access:is_public": true}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:57.575079 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-a945a5b3-be1e-4113-b893-7ebdc5a3f965 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.154632 Jun 02 13:45:57.575645 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 2 13:45:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:45:57.588475 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-30fb67a8-a665-41ed-ab1c-bd77d03ef0d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:57.679281 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-30fb67a8-a665-41ed-ab1c-bd77d03ef0d1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095063 Jun 02 13:45:57.679801 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 2 13:45:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:46:00.029062 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-a945a5b3-be1e-4113-b893-7ebdc5a3f965 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:00.030059 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-a945a5b3-be1e-4113-b893-7ebdc5a3f965 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jun 02 13:46:00.030453 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 2 13:46:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:46:00.086374 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-55e82066-8491-4bbc-abc0-f8e1e3a37481 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:46:00.173440 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-55e82066-8491-4bbc-abc0-f8e1e3a37481 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.137030 Jun 02 13:46:00.173917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 2 13:46:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:46:00.186141 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-5ea0dd36-99ee-49ff-8214-3a2ff3b09357 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:46:00.283971 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-5ea0dd36-99ee-49ff-8214-3a2ff3b09357 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101692 Jun 02 13:46:00.284618 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 2 13:46:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:46:02.666422 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-55e82066-8491-4bbc-abc0-f8e1e3a37481 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:02.667438 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-55e82066-8491-4bbc-abc0-f8e1e3a37481 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jun 02 13:46:02.668037 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 2 13:46:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:46:02.732106 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-13b25453-80bb-4e09-926d-b1d0a9fecc36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "vcpus": 8, "swap": 0, "id": "5", "ram": 16384}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:46:02.840972 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-13b25453-80bb-4e09-926d-b1d0a9fecc36 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.166765 Jun 02 13:46:02.842137 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 2 13:46:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:46:02.853917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-810e4a0c-5162-4377-b890-7525af10bf87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:46:02.857418 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:03.000320 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-810e4a0c-5162-4377-b890-7525af10bf87 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.149901 Jun 02 13:46:03.001836 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 2 13:46:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:46:27.586786 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-13b25453-80bb-4e09-926d-b1d0a9fecc36 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:27.590157 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-13b25453-80bb-4e09-926d-b1d0a9fecc36 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jun 02 13:46:27.590157 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 2 13:46:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:46:27.646926 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-8a2026f6-8ed2-4c4d-93f3-6ee029d2cb41 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:27.663874 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-8a2026f6-8ed2-4c4d-93f3-6ee029d2cb41 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069742 Jun 02 13:46:27.664427 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 2 13:46:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:46:28.668994 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-13b25453-80bb-4e09-926d-b1d0a9fecc36 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:28.669998 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-13b25453-80bb-4e09-926d-b1d0a9fecc36 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 02 13:46:28.670392 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 2 13:46:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:46:28.878543 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-065040dc-d9a5-473c-84e9-001c74f3cf9b admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:28.885176 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.wsgi [None req-065040dc-d9a5-473c-84e9-001c74f3cf9b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-065040dc-d9a5-473c-84e9-001c74f3cf9b admin admin] Request method failure captured: Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Accept: application/json Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Accept-Encoding: gzip, deflate Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Connection: keep-alive Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Content-Length: 0 Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Host: 10.222.0.33 Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Openstack-Api-Version: compute 2.90 Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Openstack-System-Scope: None Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: User-Agent: python-novaclient Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Auth-Token: gAAAAABimL80UAFnl1J1971v93oDX17LdfWf8oAyuiLQF0LR1S2kaRUoVnJfh-u_yJfqUNxBIHXImV16h9712ON17uDAOgvAvW7cLMoBDUdqXsGeZgtNIe5aYC2jmf-wQL7wxL1nTnVlTOzH_JK-uEigEwWpl3CBTMY8LyJqCtXfaMXmf0O-Rik Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Domain-Id: None Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Domain-Name: None Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Identity-Status: Confirmed Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Is-Admin-Project: True Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Project-Domain-Id: default Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Project-Domain-Name: Default Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Project-Id: aedab9ecfa9f4a4fb3686cc6fffd6442 Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Project-Name: admin Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Role: reader,admin,member Jun 02 13:46:28.888460 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Roles: reader,admin,member Jun 02 13:46:28.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:46:28.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Tenant: admin Jun 02 13:46:28.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Tenant-Id: aedab9ecfa9f4a4fb3686cc6fffd6442 Jun 02 13:46:28.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Tenant-Name: admin Jun 02 13:46:28.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User: admin Jun 02 13:46:28.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User-Domain-Id: default Jun 02 13:46:28.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User-Domain-Name: Default Jun 02 13:46:28.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User-Id: 00880a086dd1493eb2030208d4b8d370 Jun 02 13:46:28.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User-Name: admin Jun 02 13:46:28.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: method: > Jun 02 13:46:28.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: exception: Flavor 42 could not be found. Jun 02 13:46:28.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: action_args: {'id': '42'} Jun 02 13:46:28.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:46:28.891394 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:46:28.892508 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:28.893917 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-065040dc-d9a5-473c-84e9-001c74f3cf9b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:46:28.895574 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-065040dc-d9a5-473c-84e9-001c74f3cf9b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.068143 Jun 02 13:46:28.895574 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 2 13:46:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:28.900003 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-2938e404-dd63-4f50-bdd0-0642c6100dfa admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:28.903006 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:28.921934 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-2938e404-dd63-4f50-bdd0-0642c6100dfa admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025471 Jun 02 13:46:28.922498 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 2 13:46:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:46:28.938947 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-4082ffcd-7635-456c-9407-2f861f721956 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:28.961113 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-4082ffcd-7635-456c-9407-2f861f721956 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025734 Jun 02 13:46:28.961642 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 2 13:46:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:46:28.970938 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-7346e204-6e61-4f2f-a5c9-14fce5a2b467 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:28.977050 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.wsgi [None req-7346e204-6e61-4f2f-a5c9-14fce5a2b467 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-7346e204-6e61-4f2f-a5c9-14fce5a2b467 admin admin] Request method failure captured: Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Accept: application/json Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Accept-Encoding: gzip, deflate Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Connection: keep-alive Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Content-Length: 0 Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Host: 10.222.0.33 Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Openstack-Api-Version: compute 2.90 Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Openstack-System-Scope: None Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: User-Agent: python-novaclient Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Auth-Token: gAAAAABimL80UAFnl1J1971v93oDX17LdfWf8oAyuiLQF0LR1S2kaRUoVnJfh-u_yJfqUNxBIHXImV16h9712ON17uDAOgvAvW7cLMoBDUdqXsGeZgtNIe5aYC2jmf-wQL7wxL1nTnVlTOzH_JK-uEigEwWpl3CBTMY8LyJqCtXfaMXmf0O-Rik Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Domain-Id: None Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Domain-Name: None Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Identity-Status: Confirmed Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Is-Admin-Project: True Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Project-Domain-Id: default Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Project-Domain-Name: Default Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Project-Id: aedab9ecfa9f4a4fb3686cc6fffd6442 Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Project-Name: admin Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Role: reader,admin,member Jun 02 13:46:28.980277 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Roles: reader,admin,member Jun 02 13:46:28.981858 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:46:28.981858 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Tenant: admin Jun 02 13:46:28.981858 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Tenant-Id: aedab9ecfa9f4a4fb3686cc6fffd6442 Jun 02 13:46:28.981858 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Tenant-Name: admin Jun 02 13:46:28.981858 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User: admin Jun 02 13:46:28.981858 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User-Domain-Id: default Jun 02 13:46:28.981858 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User-Domain-Name: Default Jun 02 13:46:28.981858 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User-Id: 00880a086dd1493eb2030208d4b8d370 Jun 02 13:46:28.981858 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User-Name: admin Jun 02 13:46:28.981858 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: method: > Jun 02 13:46:28.981858 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: exception: Flavor 42 could not be found. Jun 02 13:46:28.981858 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: action_args: {'id': '42'} Jun 02 13:46:28.981858 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:46:28.981858 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:46:28.982669 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:28.983716 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-7346e204-6e61-4f2f-a5c9-14fce5a2b467 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:46:28.990728 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-7346e204-6e61-4f2f-a5c9-14fce5a2b467 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016058 Jun 02 13:46:28.990728 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 2 13:46:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:29.850110 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-4082ffcd-7635-456c-9407-2f861f721956 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:29.851479 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-4082ffcd-7635-456c-9407-2f861f721956 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001785 Jun 02 13:46:29.851878 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 2 13:46:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:46:30.043521 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-e3508f94-0f66-483b-beec-ab86a7b78df7 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:30.048821 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.wsgi [None req-e3508f94-0f66-483b-beec-ab86a7b78df7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-e3508f94-0f66-483b-beec-ab86a7b78df7 admin admin] Request method failure captured: Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Accept: application/json Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Accept-Encoding: gzip, deflate Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Connection: keep-alive Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Content-Length: 0 Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Host: 10.222.0.33 Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Openstack-Api-Version: compute 2.90 Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Openstack-System-Scope: None Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: User-Agent: python-novaclient Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Auth-Token: gAAAAABimL81j3l5KHvpq1G_Vugf5pHazI9qLA-hwUo-Qn9BRwsfpqWodbEgcDNM5NcBJLt32_atCmUW4FFsJjm_eMirwMpJ9MAut1_TI597YhKG88Pdnkxll9z0LkqgKw9Me6TOozvDK6ISRnBQS3e84GW9bWx1xtYORPRYO4aHdVe14xxkW_8 Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Domain-Id: None Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Domain-Name: None Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Identity-Status: Confirmed Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Is-Admin-Project: True Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Project-Domain-Id: default Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Project-Domain-Name: Default Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Project-Id: aedab9ecfa9f4a4fb3686cc6fffd6442 Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Project-Name: admin Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Role: reader,admin,member Jun 02 13:46:30.050332 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Roles: reader,admin,member Jun 02 13:46:30.052344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:46:30.052344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Tenant: admin Jun 02 13:46:30.052344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Tenant-Id: aedab9ecfa9f4a4fb3686cc6fffd6442 Jun 02 13:46:30.052344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Tenant-Name: admin Jun 02 13:46:30.052344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User: admin Jun 02 13:46:30.052344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User-Domain-Id: default Jun 02 13:46:30.052344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User-Domain-Name: Default Jun 02 13:46:30.052344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User-Id: 00880a086dd1493eb2030208d4b8d370 Jun 02 13:46:30.052344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User-Name: admin Jun 02 13:46:30.052344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: method: > Jun 02 13:46:30.052344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: exception: Flavor 84 could not be found. Jun 02 13:46:30.052344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: action_args: {'id': '84'} Jun 02 13:46:30.052344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:46:30.052344 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:46:30.053325 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:30.054805 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-e3508f94-0f66-483b-beec-ab86a7b78df7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:46:30.056236 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-e3508f94-0f66-483b-beec-ab86a7b78df7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061675 Jun 02 13:46:30.056236 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 2 13:46:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:30.062360 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-e087c259-4a27-4d0f-af74-37af58d446ef admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:30.076156 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-e087c259-4a27-4d0f-af74-37af58d446ef admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017490 Jun 02 13:46:30.076732 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 2 13:46:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:46:30.086819 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-4eab11ea-a6bc-41bf-8d5b-7ec53fe104a9 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:30.101261 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-4eab11ea-a6bc-41bf-8d5b-7ec53fe104a9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017958 Jun 02 13:46:30.101803 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 2 13:46:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:46:30.111096 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-51605ce9-f503-4e2f-bce0-a7dbc4bd7d09 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:30.117115 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.wsgi [None req-51605ce9-f503-4e2f-bce0-a7dbc4bd7d09 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-51605ce9-f503-4e2f-bce0-a7dbc4bd7d09 admin admin] Request method failure captured: Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Accept: application/json Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Accept-Encoding: gzip, deflate Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Connection: keep-alive Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Content-Length: 0 Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Host: 10.222.0.33 Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Openstack-Api-Version: compute 2.90 Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Openstack-System-Scope: None Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: User-Agent: python-novaclient Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Auth-Token: gAAAAABimL81j3l5KHvpq1G_Vugf5pHazI9qLA-hwUo-Qn9BRwsfpqWodbEgcDNM5NcBJLt32_atCmUW4FFsJjm_eMirwMpJ9MAut1_TI597YhKG88Pdnkxll9z0LkqgKw9Me6TOozvDK6ISRnBQS3e84GW9bWx1xtYORPRYO4aHdVe14xxkW_8 Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Domain-Id: None Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Domain-Name: None Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Identity-Status: Confirmed Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Is-Admin-Project: True Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Project-Domain-Id: default Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Project-Domain-Name: Default Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Project-Id: aedab9ecfa9f4a4fb3686cc6fffd6442 Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Project-Name: admin Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Role: reader,admin,member Jun 02 13:46:30.118593 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Roles: reader,admin,member Jun 02 13:46:30.120138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:46:30.120138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Tenant: admin Jun 02 13:46:30.120138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Tenant-Id: aedab9ecfa9f4a4fb3686cc6fffd6442 Jun 02 13:46:30.120138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Tenant-Name: admin Jun 02 13:46:30.120138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User: admin Jun 02 13:46:30.120138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User-Domain-Id: default Jun 02 13:46:30.120138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User-Domain-Name: Default Jun 02 13:46:30.120138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User-Id: 00880a086dd1493eb2030208d4b8d370 Jun 02 13:46:30.120138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User-Name: admin Jun 02 13:46:30.120138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: method: > Jun 02 13:46:30.120138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: exception: Flavor 84 could not be found. Jun 02 13:46:30.120138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: action_args: {'id': '84'} Jun 02 13:46:30.120138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:46:30.120138 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:46:30.121025 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:30.122210 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-51605ce9-f503-4e2f-bce0-a7dbc4bd7d09 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:46:30.123278 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-51605ce9-f503-4e2f-bce0-a7dbc4bd7d09 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012533 Jun 02 13:46:30.123278 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 2 13:46:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:30.987844 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-4eab11ea-a6bc-41bf-8d5b-7ec53fe104a9 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:30.988883 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-4eab11ea-a6bc-41bf-8d5b-7ec53fe104a9 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jun 02 13:46:30.989273 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 2 13:46:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:46:31.182310 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-4f780ea1-8f0d-4ddb-8d6f-50fb28e70c57 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:31.188029 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.wsgi [None req-4f780ea1-8f0d-4ddb-8d6f-50fb28e70c57 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-4f780ea1-8f0d-4ddb-8d6f-50fb28e70c57 admin admin] Request method failure captured: Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Accept: application/json Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Accept-Encoding: gzip, deflate Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Connection: keep-alive Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Content-Length: 0 Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Host: 10.222.0.33 Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Openstack-Api-Version: compute 2.90 Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Openstack-System-Scope: None Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: User-Agent: python-novaclient Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Auth-Token: gAAAAABimL82PUDchMoEfBZbCXCoPdWYyfYGhugLvJL4x3ol4MUtM3Egmf5FoLoxgDrQq43pLMXK5PWrNidyDZIC0_4mOn6eF4ZwnFZ5OMhvvcrQBKQ9p0QK7tz3vtQQcza1pOzu77H1-EBOIK_IdRkTTGOfdeut8gFyiJnfJM3848KYbsCRDkc Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Domain-Id: None Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Domain-Name: None Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Identity-Status: Confirmed Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Is-Admin-Project: True Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Project-Domain-Id: default Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Project-Domain-Name: Default Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Project-Id: aedab9ecfa9f4a4fb3686cc6fffd6442 Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Project-Name: admin Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Role: reader,admin,member Jun 02 13:46:31.189659 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Roles: reader,admin,member Jun 02 13:46:31.191196 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:46:31.191196 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Tenant: admin Jun 02 13:46:31.191196 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Tenant-Id: aedab9ecfa9f4a4fb3686cc6fffd6442 Jun 02 13:46:31.191196 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-Tenant-Name: admin Jun 02 13:46:31.191196 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User: admin Jun 02 13:46:31.191196 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User-Domain-Id: default Jun 02 13:46:31.191196 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User-Domain-Name: Default Jun 02 13:46:31.191196 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User-Id: 00880a086dd1493eb2030208d4b8d370 Jun 02 13:46:31.191196 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: X-User-Name: admin Jun 02 13:46:31.191196 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: method: > Jun 02 13:46:31.191196 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: exception: Flavor 451 could not be found. Jun 02 13:46:31.191196 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: action_args: {'id': '451'} Jun 02 13:46:31.191196 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:46:31.191196 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:46:31.192829 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Jun 02 13:46:31.193916 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-4f780ea1-8f0d-4ddb-8d6f-50fb28e70c57 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:46:31.194980 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-4f780ea1-8f0d-4ddb-8d6f-50fb28e70c57 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063849 Jun 02 13:46:31.194980 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 2 13:46:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:31.201598 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-6995feec-a044-42e7-be46-4bcb97ff3203 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:31.215417 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-6995feec-a044-42e7-be46-4bcb97ff3203 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017650 Jun 02 13:46:31.215941 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 2 13:46:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:46:31.225128 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-25d5bc15-db7a-4e31-9a8f-592d574cca95 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:31.239287 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-25d5bc15-db7a-4e31-9a8f-592d574cca95 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017028 Jun 02 13:46:31.239820 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 2 13:46:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:46:31.249242 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-d72845a5-66fb-4206-a0bb-92b1cfde7785 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:31.255298 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.wsgi [None req-d72845a5-66fb-4206-a0bb-92b1cfde7785 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-d72845a5-66fb-4206-a0bb-92b1cfde7785 admin admin] Request method failure captured: Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Accept: application/json Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Accept-Encoding: gzip, deflate Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Connection: keep-alive Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Content-Length: 0 Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Host: 10.222.0.33 Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Openstack-Api-Version: compute 2.90 Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Openstack-System-Scope: None Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: User-Agent: python-novaclient Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Auth-Token: gAAAAABimL82PUDchMoEfBZbCXCoPdWYyfYGhugLvJL4x3ol4MUtM3Egmf5FoLoxgDrQq43pLMXK5PWrNidyDZIC0_4mOn6eF4ZwnFZ5OMhvvcrQBKQ9p0QK7tz3vtQQcza1pOzu77H1-EBOIK_IdRkTTGOfdeut8gFyiJnfJM3848KYbsCRDkc Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Domain-Id: None Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Domain-Name: None Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Identity-Status: Confirmed Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Is-Admin-Project: True Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Project-Domain-Id: default Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Project-Domain-Name: Default Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Project-Id: aedab9ecfa9f4a4fb3686cc6fffd6442 Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Project-Name: admin Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Role: reader,admin,member Jun 02 13:46:31.256795 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Roles: reader,admin,member Jun 02 13:46:31.258374 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aedab9ecfa9f4a4fb3686cc6fffd6442"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:46:31.258374 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Tenant: admin Jun 02 13:46:31.258374 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Tenant-Id: aedab9ecfa9f4a4fb3686cc6fffd6442 Jun 02 13:46:31.258374 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-Tenant-Name: admin Jun 02 13:46:31.258374 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User: admin Jun 02 13:46:31.258374 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User-Domain-Id: default Jun 02 13:46:31.258374 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User-Domain-Name: Default Jun 02 13:46:31.258374 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User-Id: 00880a086dd1493eb2030208d4b8d370 Jun 02 13:46:31.258374 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: X-User-Name: admin Jun 02 13:46:31.258374 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: method: > Jun 02 13:46:31.258374 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: exception: Flavor 451 could not be found. Jun 02 13:46:31.258374 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: action_args: {'id': '451'} Jun 02 13:46:31.258374 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:46:31.258374 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:46:31.259423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Jun 02 13:46:31.260778 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-d72845a5-66fb-4206-a0bb-92b1cfde7785 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:46:31.262040 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-d72845a5-66fb-4206-a0bb-92b1cfde7785 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012551 Jun 02 13:46:31.262040 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 2 13:46:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:32.125801 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-25d5bc15-db7a-4e31-9a8f-592d574cca95 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:32.126841 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-25d5bc15-db7a-4e31-9a8f-592d574cca95 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 02 13:46:32.127244 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 2 13:46:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:46:32.326617 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-f49d9b73-796c-452b-826c-5bd11deb7745 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:46:32.452177 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-f49d9b73-796c-452b-826c-5bd11deb7745 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.182261 Jun 02 13:46:32.452752 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 2 13:46:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:46:33.348065 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-25d5bc15-db7a-4e31-9a8f-592d574cca95 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:33.349185 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-25d5bc15-db7a-4e31-9a8f-592d574cca95 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Jun 02 13:46:33.349583 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 2 13:46:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:46:33.538533 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-f165ba22-4858-4dea-9abd-99364b795127 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:46:33.629895 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-f165ba22-4858-4dea-9abd-99364b795127 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.142595 Jun 02 13:46:33.630446 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 2 13:46:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:46:34.501562 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-25d5bc15-db7a-4e31-9a8f-592d574cca95 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:34.502589 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-25d5bc15-db7a-4e31-9a8f-592d574cca95 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 02 13:46:34.502983 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 2 13:46:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:46:34.692379 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-fba1264a-64e1-4283-9df7-09031052d51a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:46:34.778103 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-fba1264a-64e1-4283-9df7-09031052d51a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.138023 Jun 02 13:46:34.778581 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 2 13:46:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:46:35.663124 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-25d5bc15-db7a-4e31-9a8f-592d574cca95 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:35.664125 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-25d5bc15-db7a-4e31-9a8f-592d574cca95 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jun 02 13:46:35.664574 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 2 13:46:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:46:35.852312 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-9fe47f33-9a7a-45d9-a94e-0f3dd0c2b67d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:46:35.973488 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-9fe47f33-9a7a-45d9-a94e-0f3dd0c2b67d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.171777 Jun 02 13:46:35.974035 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 2 13:46:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:46:36.845133 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-25d5bc15-db7a-4e31-9a8f-592d574cca95 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:36.846151 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-25d5bc15-db7a-4e31-9a8f-592d574cca95 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 02 13:46:36.846562 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 2 13:46:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:46:37.033028 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-211c88eb-4217-4eee-9eda-94e2c1421967 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:46:37.054386 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-211c88eb-4217-4eee-9eda-94e2c1421967 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071957 Jun 02 13:46:37.054971 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Thu Jun 2 13:46:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:47:38.834848 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-25d5bc15-db7a-4e31-9a8f-592d574cca95 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:38.835869 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-25d5bc15-db7a-4e31-9a8f-592d574cca95 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 02 13:47:38.836263 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 2 13:47:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:47:38.843504 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:38.901404 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-390ff228-132a-48ab-a460-8ba1e87d4f13 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:38.922108 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-390ff228-132a-48ab-a460-8ba1e87d4f13 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079848 Jun 02 13:47:38.922711 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 2 13:47:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:47:38.944514 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:38.948384 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-7a7d4cb7-f29b-4ea8-9557-5b4287b00300 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:38.957220 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-7a7d4cb7-f29b-4ea8-9557-5b4287b00300 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014332 Jun 02 13:47:38.957797 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1282 bytes} [Thu Jun 2 13:47:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:47:38.970020 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-548c6fcb-16c9-4d66-ae98-61102fa23c7a admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:38.978501 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-548c6fcb-16c9-4d66-ae98-61102fa23c7a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012084 Jun 02 13:47:38.979073 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1285 bytes} [Thu Jun 2 13:47:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:47:38.991610 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-9de07589-e81e-446c-a2a9-3c53f6d08bbe admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:38.999729 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-9de07589-e81e-446c-a2a9-3c53f6d08bbe admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012053 Jun 02 13:47:39.000292 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1285 bytes} [Thu Jun 2 13:47:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:47:39.012951 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-4f038458-0083-443b-ab2a-33767df4853b admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:39.021919 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-4f038458-0083-443b-ab2a-33767df4853b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012537 Jun 02 13:47:39.022401 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1282 bytes} [Thu Jun 2 13:47:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:51:43.529455 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-9de07589-e81e-446c-a2a9-3c53f6d08bbe admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:43.530453 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-9de07589-e81e-446c-a2a9-3c53f6d08bbe admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 02 13:51:43.530843 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 2 13:51:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:51:43.688240 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_api:SELECT=6 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:51:43.803301 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-b3c81b63-6a44-487a-8763-eafe172911d4 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:43.804488 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:51:43.804488 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: warnings.warn(msg) Jun 02 13:51:43.805696 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-b3c81b63-6a44-487a-8763-eafe172911d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:43.806285 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-b3c81b63-6a44-487a-8763-eafe172911d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:43.807078 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-b3c81b63-6a44-487a-8763-eafe172911d4 admin admin] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:43.807505 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-b3c81b63-6a44-487a-8763-eafe172911d4 admin admin] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:43.841574 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-b3c81b63-6a44-487a-8763-eafe172911d4 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154802 Jun 02 13:51:43.842144 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 2 13:51:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:51:44.719556 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-9de07589-e81e-446c-a2a9-3c53f6d08bbe admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:44.721311 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-9de07589-e81e-446c-a2a9-3c53f6d08bbe admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002043 Jun 02 13:51:44.721997 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 2 13:51:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:51:44.921870 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-5641e608-22cf-4453-b8ab-81dc0b6b7e4c admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:44.930722 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:51:44.930722 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: warnings.warn(msg) Jun 02 13:51:44.930722 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-5641e608-22cf-4453-b8ab-81dc0b6b7e4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:44.930722 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-5641e608-22cf-4453-b8ab-81dc0b6b7e4c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:44.930722 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-5641e608-22cf-4453-b8ab-81dc0b6b7e4c admin admin] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:44.930722 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-5641e608-22cf-4453-b8ab-81dc0b6b7e4c admin admin] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:44.946604 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-5641e608-22cf-4453-b8ab-81dc0b6b7e4c admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079092 Jun 02 13:51:44.947242 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 2 13:51:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:51:56.248701 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-9de07589-e81e-446c-a2a9-3c53f6d08bbe admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:56.249706 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-9de07589-e81e-446c-a2a9-3c53f6d08bbe admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 02 13:51:56.250103 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 2 13:51:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:51:56.391931 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_cell0:SELECT=4 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:51:56.392671 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_cell1:SELECT=4 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:51:56.393275 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_api:SELECT=8 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:51:56.442504 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-8eb4b6c9-eb45-40f9-874c-ce4a4a2fbb02 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:56.443706 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:51:56.443706 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: warnings.warn(msg) Jun 02 13:51:56.444921 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-8eb4b6c9-eb45-40f9-874c-ce4a4a2fbb02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:56.445363 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-8eb4b6c9-eb45-40f9-874c-ce4a4a2fbb02 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:56.446141 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-8eb4b6c9-eb45-40f9-874c-ce4a4a2fbb02 admin admin] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:56.446572 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-8eb4b6c9-eb45-40f9-874c-ce4a4a2fbb02 admin admin] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:56.473211 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-8eb4b6c9-eb45-40f9-874c-ce4a4a2fbb02 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084893 Jun 02 13:51:56.473211 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 2 13:51:56 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:51:57.347290 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-9de07589-e81e-446c-a2a9-3c53f6d08bbe admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:57.348309 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-9de07589-e81e-446c-a2a9-3c53f6d08bbe admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Jun 02 13:51:57.348737 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 2 13:51:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:51:57.546012 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-d62b939e-74e1-458e-aef9-3807cd7abdfb admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:57.547207 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:51:57.547207 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: warnings.warn(msg) Jun 02 13:51:57.548423 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-d62b939e-74e1-458e-aef9-3807cd7abdfb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:57.548874 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-d62b939e-74e1-458e-aef9-3807cd7abdfb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:57.549650 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-d62b939e-74e1-458e-aef9-3807cd7abdfb admin admin] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:57.550073 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-d62b939e-74e1-458e-aef9-3807cd7abdfb admin admin] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:57.571860 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-d62b939e-74e1-458e-aef9-3807cd7abdfb admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078490 Jun 02 13:51:57.572341 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 2 13:51:57 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:53:02.659953 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: Thu Jun 2 13:53:02 2022 - graceful shutdown triggered... Jun 02 13:53:02.659313 dv-cinder-826510-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 02 13:53:02.661045 dv-cinder-826510-6-iscsi devstack@n-api.service[103849]: Gracefully killing worker 1 (pid: 103849)... Jun 02 13:53:02.662489 dv-cinder-826510-6-iscsi devstack@n-api.service[103850]: Gracefully killing worker 2 (pid: 103850)... Jun 02 13:53:03.660327 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: worker 1 buried after 1 seconds Jun 02 13:53:03.660327 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: worker 2 buried after 1 seconds Jun 02 13:53:03.660327 dv-cinder-826510-6-iscsi devstack@n-api.service[103848]: goodbye to uWSGI. Jun 02 13:53:03.661947 dv-cinder-826510-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 02 13:53:03.662524 dv-cinder-826510-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 02 13:53:03.665233 dv-cinder-826510-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 02 13:53:03.679794 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 02 13:53:03.695641 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 13:53:03 2022] *** Jun 02 13:53:03.695641 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 13:53:03.695641 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 13:53:03.695641 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: nodename: dv-cinder-826510-6-iscsi Jun 02 13:53:03.695641 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: machine: x86_64 Jun 02 13:53:03.695641 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: clock source: unix Jun 02 13:53:03.695641 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: pcre jit disabled Jun 02 13:53:03.695641 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: detected number of CPU cores: 4 Jun 02 13:53:03.695641 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: current working directory: / Jun 02 13:53:03.695641 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: detected binary path: /usr/bin/uwsgi-core Jun 02 13:53:03.695641 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: your processes number limit is 47680 Jun 02 13:53:03.696590 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: your memory page size is 4096 bytes Jun 02 13:53:03.696590 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: detected max file descriptor number: 2048 Jun 02 13:53:03.696590 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: lock engine: pthread robust mutexes Jun 02 13:53:03.696590 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: thunder lock: enabled Jun 02 13:53:03.696590 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 02 13:53:03.696590 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 13:53:03.742425 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: Python main interpreter initialized at 0x55d1a70019c0 Jun 02 13:53:03.742425 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: python threads support enabled Jun 02 13:53:03.742425 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: your server socket listen backlog is limited to 100 connections Jun 02 13:53:03.742425 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: your mercy for graceful operations on workers is 90 seconds Jun 02 13:53:03.742908 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 13:53:03.742908 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: *** Operational MODE: preforking *** Jun 02 13:53:03.743118 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: *** uWSGI is running in multiple interpreter mode *** Jun 02 13:53:03.743118 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: spawned uWSGI master process (pid: 118296) Jun 02 13:53:03.743320 dv-cinder-826510-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 02 13:53:03.746136 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: spawned uWSGI worker 1 (pid: 118315, cores: 1) Jun 02 13:53:03.746136 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: spawned uWSGI worker 2 (pid: 118316, cores: 1) Jun 02 13:53:03.746136 dv-cinder-826510-6-iscsi devstack@n-api.service[118296]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 13:53:05.003385 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 13:53:05.030460 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 13:53:05.841338 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:53:05.841338 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: from cryptography.utils import int_from_bytes Jun 02 13:53:05.852946 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:53:05.852946 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: from cryptography.utils import int_from_bytes Jun 02 13:53:05.878360 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:53:05.878360 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: from cryptography.utils import int_from_bytes Jun 02 13:53:05.878697 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:53:05.878697 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: from cryptography.utils import int_from_bytes Jun 02 13:53:08.260125 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:53:08.260712 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:53:08.260991 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:53:08.261283 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:53:08.261539 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:53:08.261925 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.262247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.262567 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.262881 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.263791 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.264058 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.264367 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.264716 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.265042 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.265302 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.265614 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.265936 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826510-6-iscsi {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.266256 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.266576 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.266872 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.267188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.267490 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.267810 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.268111 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.268634 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.270164 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.270164 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.270164 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.270164 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.270505 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.270675 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.270922 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.271182 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.271519 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.271864 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.272228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826510-6-iscsi {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.272551 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.272865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.273181 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.273434 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:53:08.274150 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.274410 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:53:08.274638 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.274638 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.275085 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:53:08.275321 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.275534 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:53:08.275763 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.275959 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:53:08.276144 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.276334 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.276539 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.276756 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.276937 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.277091 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.277240 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.277430 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.277584 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.277761 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.277910 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.278066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.278248 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.278408 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.278576 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.278766 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.279642 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.279803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.279953 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.280370 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.280579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.280749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.280899 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.281057 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826510-6-iscsi {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.281213 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.281409 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.281606 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.281606 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.282329 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.282491 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.282663 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.282822 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.283791 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.283965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.284129 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.284279 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.284463 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.284631 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.284792 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.284949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.284949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.285666 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.285852 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.286013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.286263 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.286420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.286579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.286728 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.286885 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.287034 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.287181 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.287337 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.287624 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.287781 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.287940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.288089 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.288244 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.288474 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.288664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.288827 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.288993 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.289150 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.289315 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.289471 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826510-6-iscsi {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.289631 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.289833 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.289993 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.290149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.290298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.290464 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.290629 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.290812 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.290965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.291124 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.291283 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.291439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.291596 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.291755 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.291914 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.292072 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.292220 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.292374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.292598 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.292756 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.292940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.293098 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.293262 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.293613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.294005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.294172 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.294612 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.294892 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.295052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.295186 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.295310 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.295856 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.295991 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.296115 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.296237 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.296364 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.300463 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.300628 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.300777 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.300937 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.301095 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.301261 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.301567 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.301794 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.301960 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.302108 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.302333 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.302503 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.302657 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.302805 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.302955 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.303103 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.303342 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.303515 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.303849 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.304252 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.304481 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.304646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.304808 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.304971 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.305129 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.305285 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.305479 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.305814 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.306156 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.306307 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.306307 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.306596 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.306764 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.306930 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.307191 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.307387 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.307610 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.307779 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.307935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.308090 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.308248 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.308441 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.308620 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.308770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.308925 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.309091 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.309248 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.309395 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.309560 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.309897 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.310113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.310376 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.310537 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.310697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.310936 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.311096 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.311260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.311463 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.311628 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.311868 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.312020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.312205 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.312205 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.312548 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.312708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.312866 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.313027 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.313477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.313645 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.313999 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.314392 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.314564 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.314723 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.314881 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.315037 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.315193 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.315349 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.315542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.315882 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.316256 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.316453 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.316621 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.316782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.316943 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.316943 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.317234 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.317390 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.317547 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.317705 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.317889 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.318050 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.318351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.318540 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.318697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.318857 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.319007 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.319168 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.319352 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.319537 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.319690 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.319848 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.320161 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.320325 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.320519 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.320709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.320876 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.321034 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.321194 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.321367 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.321553 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.321742 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.322520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.322691 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.322851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.323010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.323169 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.323320 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.323852 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.324177 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.324541 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.324712 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.324874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.325023 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.325170 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.325326 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.325568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.329387 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.329575 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.329735 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.329896 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.330048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.330048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.330348 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.330542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.330710 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.330860 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.331020 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.331183 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.332741 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.332902 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.333052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.333201 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.333361 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.333527 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.333687 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.333837 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.334115 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.334437 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.334744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.335540 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.335705 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.335857 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.336015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.336165 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.336324 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.336510 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.337022 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.337188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.337338 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.337440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.337608 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.337719 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.337817 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.337913 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.338015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.338117 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.338214 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.338317 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.338520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.338675 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.338832 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.338983 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.339142 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.339312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:53:08.339462 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.339656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.339819 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.340011 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.340165 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.340329 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.340523 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.340675 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.340824 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.340980 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.341150 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.341426 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.342084 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.342243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.342401 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.342561 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.342724 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.342883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.343041 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.343200 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.343358 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.343507 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.343712 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.343878 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.344035 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.344518 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.344856 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.345119 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.345287 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.345446 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.345602 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.345768 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.345935 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.346091 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.346257 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.346413 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.346625 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.347044 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.347311 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.347491 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.347649 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.347849 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.348048 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.348209 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.348377 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.348650 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.348959 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.349128 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.349301 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.349478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.349636 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.349800 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.349956 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.350110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.350273 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.350430 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.350593 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.350593 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.350906 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.351062 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.351225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.351398 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.351564 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.351727 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.351894 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.352058 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.352222 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.352384 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.352579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.352744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.352900 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.353055 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.353218 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.353373 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.354032 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.354220 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.354476 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.354820 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.355128 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.355291 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.355462 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.355630 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.355797 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.356006 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.356164 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.356333 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.356555 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.356725 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.357095 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.357371 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.357621 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.357801 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.357968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.358131 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.358288 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.358442 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.358596 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.358759 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.358917 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.359071 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.359244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.359408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.359571 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.359736 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.359893 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.360061 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.360226 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.360380 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.360571 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.360740 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.360903 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.361067 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.361327 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.361488 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.361664 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.361828 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.361985 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.362153 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.362310 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.362464 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.362633 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.362835 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.363006 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.363163 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.363326 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.363496 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.363661 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.363817 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.363817 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.363817 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.363817 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.364590 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.364906 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.365235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.365411 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.365576 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.365733 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.365733 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.366051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.366207 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.366361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.366524 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.366691 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.366858 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.367119 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.367364 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.367734 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.367911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.368069 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.368239 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.368397 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.368590 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.368745 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.368910 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.369076 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.369242 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.369399 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.369553 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.369714 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.369878 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.370042 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.370207 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.370364 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.370530 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.370685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.370846 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.371011 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.371167 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.371329 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.371486 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.371640 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.371793 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.372051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.372250 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.372447 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.372664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.372846 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.373011 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.373181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.373344 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.373521 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.373686 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.373841 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.374009 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.374173 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.374334 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.374496 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.374745 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.375053 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.375389 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.375564 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.375722 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.375884 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.376077 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.376239 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.376428 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.376601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.376758 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.376921 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.377175 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.377368 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.377623 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.377968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.378131 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.378287 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.378451 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.378626 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.378799 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.378990 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.379151 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.379307 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.379470 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.379639 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.379804 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.379979 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.380220 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.380390 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.380604 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.380773 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.380931 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.381085 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.381349 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.381512 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.381667 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.381836 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.382000 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.382156 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.382322 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.382476 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.382714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.382872 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.383034 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.383202 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.383366 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.383530 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.383698 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.383862 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.384019 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.384019 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.384322 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.384511 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.384687 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.384939 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.385257 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.385578 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.385742 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.385906 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.386071 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.386229 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.386384 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.386549 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.386705 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.386870 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.387037 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.387285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.388981 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.389157 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.389333 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.389490 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.389654 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.389811 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.389975 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.390131 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.390288 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.390465 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.390621 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.390813 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.390980 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.391143 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.391299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.391455 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.391609 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.391777 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.391990 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.392167 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.392324 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.392512 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.392701 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.392869 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.393032 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.393198 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.393363 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.393520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.393520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.393840 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.394004 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.394159 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.394321 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.394485 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.394640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.394923 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.395120 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.395435 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.395770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.395932 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.396102 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.396341 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.396525 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.396683 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.396907 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.397064 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.397228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.397495 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.397939 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.398323 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.398487 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.398652 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.398652 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.398968 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.399132 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.399295 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.399458 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.399613 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.399782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.399947 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.400114 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.400269 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.400527 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.400941 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.401110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.401267 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.401423 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.401586 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.401750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.401917 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.402254 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.402366 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.402498 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.402624 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.402781 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.402900 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.403032 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.403133 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.403245 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.403341 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.403429 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.403515 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.403601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.403696 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.403969 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.404660 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.404755 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.404843 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.405074 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.405183 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.405282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.405414 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.405535 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.405636 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.405912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.406027 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.406118 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.406215 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.406311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.406399 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.406486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.406486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.406663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.406759 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.406847 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.406942 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.407043 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.407140 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.407227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.407314 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.407407 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.407519 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.407617 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.407718 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.407813 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.407908 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.408155 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.408277 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.408472 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.408568 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.408664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.408753 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.408849 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.408944 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.409046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.409143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.409231 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.409326 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.409415 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.409509 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.409607 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.409704 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.409818 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.409912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.409999 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.410095 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.410193 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.410281 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.410366 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.410466 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.410561 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.410657 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.410754 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.410850 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.410938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.411023 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.411244 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.411356 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.411452 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.411540 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.411626 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.411712 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.411798 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.411798 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.411966 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.412052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.412153 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.412242 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.412391 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.412517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.412616 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.412704 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.412870 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.412960 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.413047 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.413132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.413218 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.413312 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.413409 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.413504 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.413591 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.413677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.413763 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.413856 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.413957 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.414046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.414133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.414218 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.414311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.414412 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.414500 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.414587 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.414672 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.414765 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.414852 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.414950 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.415045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.415188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.415284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.415379 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.415474 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.415582 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.415725 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.415822 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.415983 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.416075 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.416170 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.416272 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.416377 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.416486 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.416587 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.416682 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.416862 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.417224 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.417333 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.417431 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.417520 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.417607 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.417703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.417798 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.417893 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.417986 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.418078 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.418316 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.418316 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.418513 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.418609 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.418741 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.418841 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.418929 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.419026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.419115 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.419201 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.419294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.419382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.419524 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.419704 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.419802 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.419890 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.420003 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.420100 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.420203 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.420292 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.420387 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.420596 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.420693 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.420780 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.420887 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.420991 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.421080 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.421167 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.421281 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.421411 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.421517 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.421606 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.421693 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.421779 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.421865 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.421865 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.422040 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.422136 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.422232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.422320 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.422406 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.422501 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.422589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.422687 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.422785 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.422924 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.423050 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.423174 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.423297 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.423419 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.423516 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.423604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.423689 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.423795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.423901 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.423991 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.424077 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.424162 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.424262 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.424350 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.424461 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.424552 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.424627 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.424707 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.424793 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.424869 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.424948 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.425021 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.425100 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.425180 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.425262 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.425336 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.425415 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.425415 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.425554 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.425634 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.425716 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.425716 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.425854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.425933 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.426015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.426088 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.426172 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.426253 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.426334 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.426414 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.426414 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.426552 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.426627 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.426700 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.426780 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.426862 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.426943 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.427036 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.427111 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.427308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.427396 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.427479 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.427561 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.427644 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.427718 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.427790 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.427863 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.427943 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.428025 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.428113 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.428186 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.428265 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.428551 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.428641 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.428735 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.428811 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.428891 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.428965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.429037 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.429109 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.429190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.429272 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.429346 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.429426 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.429499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.429578 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.429660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.429740 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.429824 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.429905 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.429978 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.430057 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.430139 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.430221 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.430303 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.430433 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.430530 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.430628 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.430724 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.430818 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.430905 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.430991 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.431084 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.431182 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.431271 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.431365 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.431460 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.431542 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.431615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.431710 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.431797 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.431883 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.431969 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.432055 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.432148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.432249 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.432337 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.432440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.432529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.432616 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.432705 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.432789 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.432870 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.432943 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.433022 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.433022 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.433162 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.433236 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.433308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.433379 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.433450 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.433529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.433615 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.433697 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.433769 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.433841 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.433912 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.433992 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.434143 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.434219 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.434307 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.434381 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.434453 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.434553 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.434641 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.434733 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.434820 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.434915 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.435002 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.435641 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.435733 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.435819 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.435904 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.435999 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.436097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.436194 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.436281 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.436374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.436526 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.436617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.436703 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.436804 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.436899 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.436987 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.437073 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.437159 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.437159 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.437343 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.437441 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.437441 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.437441 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.437441 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.437441 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.437441 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.437921 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.438016 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.438112 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.438207 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.438303 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.438398 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.438490 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.438727 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.438828 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.438961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.439088 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.439205 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.439309 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.439408 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.439511 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.439607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.439703 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.439798 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.439798 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.439798 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.439798 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.440127 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.440214 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.440300 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.440393 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.440393 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.440668 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.440764 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.440860 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.440860 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.441027 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.441127 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.441216 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.441302 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.441397 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.441492 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.441579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.441724 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.441829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.441926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.442022 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.442119 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.442215 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.442315 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.442404 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.442489 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.442575 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.442669 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.442770 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.442857 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.442944 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.443029 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.443116 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.443116 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.443287 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.443287 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.443453 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.443453 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.443611 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.443705 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.443802 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.443897 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.443984 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.444071 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.444166 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.444261 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.444356 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.444578 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.444684 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.444782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.444871 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.444871 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.445041 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.445136 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.445232 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.445327 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.445415 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.445510 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.445604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.445680 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.445753 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.445854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.445943 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.446038 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.446126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.446218 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.446313 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.446400 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.446486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.446582 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.446677 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.446778 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.446873 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.446961 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.447056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.447144 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.447238 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.447333 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.447430 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.447519 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.447677 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.447774 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.447857 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.447931 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.448014 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.448095 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.448183 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.448258 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.448330 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.448432 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.448932 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.449071 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.449199 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.449322 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.449458 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.449550 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.449637 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.449734 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.449823 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.449910 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.450005 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.450100 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.450196 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.450294 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.450382 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.450477 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.450573 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.450754 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.451383 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.451488 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.451584 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.451672 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.451758 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.451859 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.451948 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.452043 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.452132 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.452227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.452315 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.452510 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.452616 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.452704 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.452791 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.452878 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.452973 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.453061 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.453157 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.453252 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.453341 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.453427 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.453514 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.453611 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.453709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.453797 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.453885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.453885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.454044 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.454044 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.454220 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.454220 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.454387 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.454475 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.454562 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.454657 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.454746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.454842 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.454930 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.455025 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.455120 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.455217 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.455313 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.455409 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.455504 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.455600 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.455695 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.455797 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.455894 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.455983 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.456077 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.456165 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.456265 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.456362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.456467 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.456569 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.456658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.456746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.456848 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.456937 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.457023 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.457118 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.457212 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.457301 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.457402 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.457499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.457595 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.457702 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.457791 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.457888 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.457983 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.458071 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.458167 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.458375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.458477 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.458689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.458795 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.459048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.459153 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.459333 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.459465 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.459615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.459709 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.459901 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.459998 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.460213 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.460310 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.460551 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.460651 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.460870 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.460966 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.461185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.461301 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.461502 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.461588 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.461835 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.462065 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.462169 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.462394 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.462498 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.462710 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.462820 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.463026 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.463130 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.463340 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.463562 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.463659 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.463876 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.463982 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.464209 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.464307 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.464561 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.464675 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.464887 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.464993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.465195 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.465291 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.465511 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.465606 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.465829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.465925 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.466134 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.466229 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.466536 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.466645 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.466818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.466931 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.467134 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.467239 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.467449 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.467546 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.467764 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.467876 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.468084 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.468180 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.468389 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.468512 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.468743 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.468855 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.469053 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.469163 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.469413 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.469585 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.469729 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.469935 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.470033 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.470250 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.470355 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.470578 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.470689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.470904 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.471010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.471220 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.471326 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.471527 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.471703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.471838 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.471933 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.472143 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.472240 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.472480 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.472674 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.472797 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.472897 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.473106 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.473213 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.473411 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.473509 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.473713 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.473817 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.474022 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.474120 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.474331 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.474545 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.474642 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.474859 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.474956 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.475189 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.475296 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.475512 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.475609 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.475820 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.475923 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.476123 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.476221 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.476467 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.476611 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.476785 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.476887 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.477091 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.477188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.477393 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.477489 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.477698 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.477795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.477999 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.478096 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.478301 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.478397 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.478600 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.478705 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.478907 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.479012 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.479211 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.479320 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.479519 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.479614 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.479823 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.479921 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.480132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.480356 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.480519 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.480730 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.484479 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.484637 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.484762 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.484882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.485015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.485146 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.485286 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.485411 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.485536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.485536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.485763 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.485889 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.486007 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.486131 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.486248 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.486363 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.486488 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.486605 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.486703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.486703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.486876 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.486965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.487061 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.487150 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.487237 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.487323 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.487410 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.487497 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.487694 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.487814 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.487913 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.488010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.488100 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.488192 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.488295 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.488385 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.488541 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.488652 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.488751 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.488854 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.488953 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.489050 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.489139 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.489242 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.489336 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.489426 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.489426 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.489591 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.489667 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.489747 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.489837 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.489921 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.490007 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.490082 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.490163 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.490245 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.490343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.490432 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.490519 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.490614 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.490711 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.490800 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.490897 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.490993 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.491083 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.491169 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.491263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.491473 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.491473 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.491663 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.491663 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.491831 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.491971 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.492077 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.492212 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.492310 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.492547 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.492662 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.492855 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.492963 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.493161 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.493267 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.493468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.493572 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.493779 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.493893 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.494107 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.494206 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.494419 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.494648 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.494784 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.496439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.496563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.496648 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.496741 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.496822 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.496910 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.496994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.497069 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.497144 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.497218 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.497293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.497376 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.497452 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.497534 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.498138 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.498217 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.498301 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.498386 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.498461 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.498542 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.498617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.498697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.498864 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.499029 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.499174 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.499357 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.499470 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.499684 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.499798 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.499991 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.500109 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.500295 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.500392 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.501120 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.501213 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.501290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.501364 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.501445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.501527 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.502308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.502560 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.502675 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.502880 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.502984 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.503225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.503354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.503526 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.503626 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.503831 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.503939 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.504138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.504235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.504464 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.504579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.504776 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.504882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.505079 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.505177 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.505381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.505489 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.505685 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.505789 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.505986 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.506096 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.506288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.506392 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.506589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.506703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.506896 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.507000 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.507197 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.507316 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.507500 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.507629 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.507799 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.507948 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.508101 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.508268 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.508421 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.508619 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.508751 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.508928 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.509082 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.509250 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.509393 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.509561 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.509713 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.509866 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.510051 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.510433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.510561 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.510662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.510763 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.510860 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.510956 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.511126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.511234 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.511448 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.511547 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.511754 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.511928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.512194 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.512304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.512474 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.512569 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.512658 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.512774 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.512970 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.513070 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.513892 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.513999 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.514205 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.514303 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.514510 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.514642 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.514817 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.514969 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.515121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.515294 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.515430 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.515600 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.515733 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.515926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.516023 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.516242 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.516348 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.516605 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.516777 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.516923 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.517021 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.517220 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.517317 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.517522 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.517628 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.517824 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.517921 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.518124 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.518230 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.518430 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.518527 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.518731 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.518828 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.519034 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.519132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.519334 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.519440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.519636 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.519743 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.519936 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.520072 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.520266 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.520364 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.520597 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.520710 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.520919 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.521024 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.521238 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.521333 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.521543 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.521654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.521864 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.522019 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.522195 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.522298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.522478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.522587 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.522793 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.522892 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.523105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.523210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.523425 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.523537 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.523636 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:53:08.523737 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.524028 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.524339 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.524673 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.524984 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.525297 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.525606 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.525929 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.526257 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.526564 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.526887 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.527203 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.527520 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.527835 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.528143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.528501 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.528831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.529211 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.529530 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.529839 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.530149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.530464 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.530781 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.531105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.531429 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.531738 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.532387 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.532754 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.533065 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.533408 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.533734 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.534047 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.534356 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.534658 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:53:08.534899 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:53:08.583018 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO dbcounter [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] Registered counter for database nova_api Jun 02 13:53:08.594655 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO dbcounter [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] Registered counter for database nova_api Jun 02 13:53:08.602513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_db.sqlalchemy.engines [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:53:08.609259 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writer thread running {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:53:08.614168 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_db.sqlalchemy.engines [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:53:08.620682 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writer thread running {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:53:08.666914 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.context [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b23e70ef-c1f8-4cdc-b345-bb99123a3df5(cell1) {{(pid=118316) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 13:53:08.671073 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:53:08.672668 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:53:08.673470 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:53:08.675413 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:53:08.677390 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO dbcounter [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] Registered counter for database nova_cell0 Jun 02 13:53:08.679397 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.context [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b23e70ef-c1f8-4cdc-b345-bb99123a3df5(cell1) {{(pid=118315) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 13:53:08.681445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO dbcounter [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] Registered counter for database nova_cell1 Jun 02 13:53:08.683538 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:53:08.685676 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:53:08.686606 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:53:08.688652 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:53:08.688925 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_db.sqlalchemy.engines [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:53:08.690559 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_db.sqlalchemy.engines [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:53:08.690828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO dbcounter [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] Registered counter for database nova_cell0 Jun 02 13:53:08.694941 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO dbcounter [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] Registered counter for database nova_cell1 Jun 02 13:53:08.696155 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writer thread running {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:53:08.699128 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writer thread running {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:53:08.702719 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_db.sqlalchemy.engines [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:53:08.704957 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_db.sqlalchemy.engines [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:53:08.709549 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writer thread running {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:53:08.844619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO dbcounter [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] Registered counter for database nova_cell0 Jun 02 13:53:08.849231 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writer thread running {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:53:08.851460 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_db.sqlalchemy.engines [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:53:08.855810 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writer thread running {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:53:08.860441 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO dbcounter [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] Registered counter for database nova_cell0 Jun 02 13:53:08.869811 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_db.sqlalchemy.engines [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:53:08.875245 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writer thread running {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:53:09.297818 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: WARNING keystonemiddleware.auth_token [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:53:09.305283 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: WARNING keystonemiddleware.auth_token [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:53:09.319224 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: WARNING keystonemiddleware.auth_token [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:53:09.328342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: WARNING keystonemiddleware.auth_token [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:53:09.532225 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: WARNING keystonemiddleware.auth_token [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:53:09.538477 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: WARNING keystonemiddleware.auth_token [None req-aded6f19-16cd-4fa9-8dc8-6618f57db148 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:53:09.543591 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1a70019c0 pid: 118316 (default app) Jun 02 13:53:09.559671 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: WARNING keystonemiddleware.auth_token [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:53:09.566984 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: WARNING keystonemiddleware.auth_token [None req-0cf0b5eb-fed7-4cad-a7fe-e58cf77d0ffb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:53:09.572336 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1a70019c0 pid: 118315 (default app) Jun 02 13:53:53.233717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=3 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:53.235155 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=3 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:53.236314 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=3 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:53.237556 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=3 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:54.972181 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ec6a63bb-2013-438b-a4f4-3aa27078459f tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] Action: 'create', calling method: .version_select at 0x7fb720f26310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1751736885", "metadata": {"Type": "work"}}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:53:57.141920 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=3 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:57.143101 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=3 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:57.151735 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=3 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:57.153766 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=3 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:57.501889 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ec6a63bb-2013-438b-a4f4-3aa27078459f tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.279172 Jun 02 13:53:57.502511 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 2 13:53:53 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4282 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 02 13:53:57.517305 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ba958dbd-1049-42e6-bc9e-7d076a9469bb tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] Calling method '.version_select at 0x7fb720deb310>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:53:57.614485 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ba958dbd-1049-42e6-bc9e-7d076a9469bb tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3" status: 200 len: 353 microversion: 2.1 time: 0.103843 Jun 02 13:53:57.619520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 2/2] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 13:53:57 2022] GET /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:53:58.563601 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ba6b1e27-1399-4a20-94d0-fe157c26dcb4 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] Calling method '.version_select at 0x7fb720deb670>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:53:58.612645 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-486676771", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "networks": [{"uuid": "93c37164-809b-420e-94f2-81f18fa3e2a9"}]}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:53:58.659897 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ba6b1e27-1399-4a20-94d0-fe157c26dcb4 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c6e8e036-f53c-4db4-9548-85777511f447" status: 200 len: 351 microversion: 2.1 time: 0.100486 Jun 02 13:53:58.667647 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 3/3] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 13:53:58 2022] GET /compute/v2.1/os-volumes/c6e8e036-f53c-4db4-9548-85777511f447 => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:53:58.674204 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-28a3c69e-6d71-4655-9b1f-57c1a05f93a9 tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] Calling method '.version_select at 0x7fb720debaf0>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:53:58.768510 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-28a3c69e-6d71-4655-9b1f-57c1a05f93a9 tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3" status: 200 len: 353 microversion: 2.1 time: 0.099549 Jun 02 13:53:58.773560 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 4/4] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 13:53:58 2022] GET /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:53:59.080661 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.network.neutron [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] validate_networks() for [('93c37164-809b-420e-94f2-81f18fa3e2a9', None, None, None, None, None)] {{(pid=118315) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:53:59.785352 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c20665f7-e449-4b53-8689-4c2632f0f882 tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] Calling method '.version_select at 0x7fb720d831f0>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:53:59.869756 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c20665f7-e449-4b53-8689-4c2632f0f882 tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3" status: 200 len: 354 microversion: 2.1 time: 0.092408 Jun 02 13:53:59.882034 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 5/5] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 13:53:59 2022] GET /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:53:59.887648 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5ba30c48-2f03-47b6-96bd-2d93239332cc tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] Calling method '.version_select at 0x7fb720debd30>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:53:59.967738 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5ba30c48-2f03-47b6-96bd-2d93239332cc tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3" status: 200 len: 354 microversion: 2.1 time: 0.083950 Jun 02 13:53:59.968323 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 6/6] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 13:53:59 2022] GET /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:53:59.985622 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-433649f6-795f-4d43-aba8-0060eecd556f tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] Calling method '.version_select at 0x7fb720deb4c0>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:00.344451 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-433649f6-795f-4d43-aba8-0060eecd556f tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3" status: 202 len: 0 microversion: 2.1 time: 0.363587 Jun 02 13:54:00.345769 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 7/7] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 2 13:53:59 2022] DELETE /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:54:00.359508 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-76f2b433-0735-480c-bc6a-34bd1c5fe3d6 tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] Calling method '.version_select at 0x7fb720d83550>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:00.497882 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-76f2b433-0735-480c-bc6a-34bd1c5fe3d6 tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3" status: 200 len: 353 microversion: 2.1 time: 0.148237 Jun 02 13:54:00.498475 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 8/8] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 13:54:00 2022] GET /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3 => generated 353 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:54:01.475764 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Flavor limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:54:01.476287 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Image limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:54:01.476696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Flavor pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:54:01.477105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Image pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:54:01.477513 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:54:01.502943 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:01.503121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:01.509613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:01.510246 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:01.512705 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0ff56726-62ec-46b8-b2b8-d3bca4243e4b tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] Calling method '.version_select at 0x7fb720deb8b0>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:01.591014 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Getting quotas for project 50e9456d87f7446593f2e09b71de4c61. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:54:01.600772 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-0ff56726-62ec-46b8-b2b8-d3bca4243e4b tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] HTTP exception thrown: Volume 4e937eeb-ba0e-4553-8467-3946e69982d3 could not be found. Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0ff56726-62ec-46b8-b2b8-d3bca4243e4b tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] Request method failure captured: Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: GET /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3 HTTP/1.1 Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMDxP0kw4ZfwSgkRXmS5GqFi-GKPbKtzWPdwzDvdxhOI-7lv55pIAOwmwIwoWOsLUgozl7UEAYDpKPDuhvLI7juwimdVNSvoL4p6WBpoEEhbxVbgG8sOUZIrdON13VEN8mdUK8YlRj767ukknrfLclSaSgzo7C8bv0NLWh-29owLc9Y Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 91ff9725b24d4f4497fb30b5be5f5042 Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-VolumesGetTestJSON-1255889464 Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 13:54:01.605046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 13:54:01.608138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91ff9725b24d4f4497fb30b5be5f5042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91ff9725b24d4f4497fb30b5be5f5042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91ff9725b24d4f4497fb30b5be5f5042"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91ff9725b24d4f4497fb30b5be5f5042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:54:01.608138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-VolumesGetTestJSON-1255889464 Jun 02 13:54:01.608138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 91ff9725b24d4f4497fb30b5be5f5042 Jun 02 13:54:01.608138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-VolumesGetTestJSON-1255889464 Jun 02 13:54:01.608138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-VolumesGetTestJSON-1255889464-project Jun 02 13:54:01.608138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 13:54:01.608138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 13:54:01.608138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 55e65624f420449d98bc45a04cba77f3 Jun 02 13:54:01.608138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-VolumesGetTestJSON-1255889464-project Jun 02 13:54:01.608138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: Jun 02 13:54:01.608138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Volume 4e937eeb-ba0e-4553-8467-3946e69982d3 could not be found. Jun 02 13:54:01.608138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': '4e937eeb-ba0e-4553-8467-3946e69982d3'} Jun 02 13:54:01.608138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4e937eeb-ba0e-4553-8467-3946e69982d3 could not be found. (HTTP 404) (Request-ID: req-10650b30-513e-467b-a6f7-d947a37c5e7b) Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:01.608928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:54:01.610184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4e937eeb-ba0e-4553-8467-3946e69982d3 could not be found. Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 13:54:01.611408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:54:01.612714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4e937eeb-ba0e-4553-8467-3946e69982d3 could not be found. Jun 02 13:54:01.612714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:54:01.612714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:01.612714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:54:01.612714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:01.612714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:54:01.612714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:54:01.612714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:54:01.612714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:54:01.612714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4e937eeb-ba0e-4553-8467-3946e69982d3 could not be found. Jun 02 13:54:01.612714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:54:01.612714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0ff56726-62ec-46b8-b2b8-d3bca4243e4b tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] Returning 404 to user: Volume 4e937eeb-ba0e-4553-8467-3946e69982d3 could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:54:01.612714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0ff56726-62ec-46b8-b2b8-d3bca4243e4b tempest-VolumesGetTestJSON-1255889464 tempest-VolumesGetTestJSON-1255889464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3" status: 404 len: 109 microversion: 2.1 time: 0.100127 Jun 02 13:54:01.612714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 9/9] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 13:54:01 2022] GET /compute/v2.1/os-volumes/4e937eeb-ba0e-4553-8467-3946e69982d3 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:54:01.615175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Getting quotas for user 726a1e35b0ba437db464fbe108b0cd77 and project 50e9456d87f7446593f2e09b71de4c61. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:54:01.640147 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Going to run 1 instances... {{(pid=118315) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:54:01.643407 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118315) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:54:01.870617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-9cca9755-1230-46c8-97e0-796b9ec6813a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.743324 Jun 02 13:54:01.871721 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 1/10] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 13:53:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:54:01.882465 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3bcc5706-36a9-4666-aab0-d2c1648fa000 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:01.885239 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3bcc5706-36a9-4666-aab0-d2c1648fa000 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:02.077429 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3bcc5706-36a9-4666-aab0-d2c1648fa000 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:02.093190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3bcc5706-36a9-4666-aab0-d2c1648fa000 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1214 microversion: 2.1 time: 0.214871 Jun 02 13:54:02.094159 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 2/11] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:01 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1214 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:02.099377 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-8f5b851c-8eaa-4aa4-952a-10c1c948e503 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] Calling method '.version_select at 0x7fb7205263a0>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:02.227330 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-8f5b851c-8eaa-4aa4-952a-10c1c948e503 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/291c3fa7-a4e0-4bbc-a6ac-800046865bb2" status: 200 len: 350 microversion: 2.1 time: 0.131870 Jun 02 13:54:02.228382 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 3/12] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 13:54:02 2022] GET /compute/v2.1/os-volumes/291c3fa7-a4e0-4bbc-a6ac-800046865bb2 => generated 350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:54:02.796158 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2c7f42bc-7200-42f3-b8f2-fe9509794f2c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Action: 'create', calling method: .version_select at 0x7fb721762430>, body: {"keypair": {"name": "tempest-keypair-1218029708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJhOQ8XpY85JQWRBmXzqOKo03ISxczFKXH5qXcCcaCjjfqzMUjx2Sog014KQB/HYeS0/7aoJuvCkZcFLa54pKei+tEoCt5NzwuRyvUvLK/PwgxTfQCv3ffiajA+WIRR3g=="}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:02.930568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-2c7f42bc-7200-42f3-b8f2-fe9509794f2c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Getting quotas for project 56c3f04e3f164a77b32b1e320d979863. Resources: {'key_pairs'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:54:02.960052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-2c7f42bc-7200-42f3-b8f2-fe9509794f2c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Getting quotas for user 4dd10f5fa400450fb64360391a871bb8 and project 56c3f04e3f164a77b32b1e320d979863. Resources: {'key_pairs'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:54:03.119802 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-8f279ae8-efa2-4595-88dc-f025dc23a5b7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:03.120643 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-8f279ae8-efa2-4595-88dc-f025dc23a5b7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:03.141696 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2c7f42bc-7200-42f3-b8f2-fe9509794f2c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.370587 Jun 02 13:54:03.142692 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 10/13] 10.222.0.33 () {62 vars in 1199 bytes} [Thu Jun 2 13:54:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1372 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 02 13:54:03.245739 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-8f279ae8-efa2-4595-88dc-f025dc23a5b7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:03.254139 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-8f279ae8-efa2-4595-88dc-f025dc23a5b7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1214 microversion: 2.1 time: 0.147681 Jun 02 13:54:03.256890 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 4/14] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:03 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:04.276447 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-30b96f4c-8b10-4343-81cb-43a51a0566d4 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:04.292916 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-30b96f4c-8b10-4343-81cb-43a51a0566d4 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:04.574790 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-30b96f4c-8b10-4343-81cb-43a51a0566d4 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:04.633867 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-30b96f4c-8b10-4343-81cb-43a51a0566d4 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1214 microversion: 2.1 time: 0.364112 Jun 02 13:54:04.662525 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 11/15] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:04 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1214 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:05.346870 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-df9bd23f-4c7b-415d-828e-b7031cdfc29c tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] Calling method '.version_select at 0x7fb7204aaee0>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:05.399490 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1931385186", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:05.404711 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-df9bd23f-4c7b-415d-828e-b7031cdfc29c tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/02fa0deb-2978-4adb-a89e-ffed475ee4bb" status: 200 len: 351 microversion: 2.1 time: 0.061341 Jun 02 13:54:05.405347 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 12/16] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 13:54:05 2022] GET /compute/v2.1/os-volumes/02fa0deb-2978-4adb-a89e-ffed475ee4bb => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:54:05.417070 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-57ce98dd-bcaf-461b-843d-7cfebc4a3396 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] Calling method '.version_select at 0x7fb7204b8280>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:05.530196 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.network.neutron [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] validate_networks() for [('d18c7729-7b7d-45e9-aff0-7bcd407a86fb', None, None, None, None, None)] {{(pid=118315) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:54:05.610521 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-57ce98dd-bcaf-461b-843d-7cfebc4a3396 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.197599 Jun 02 13:54:05.611158 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 13/17] 10.222.0.33 () {58 vars in 1133 bytes} [Thu Jun 2 13:54:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:05.624707 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3c4e548b-f5ff-48fc-9d3e-d78f7ac120f3 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] Calling method '.version_select at 0x7fb7204aaca0>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:05.751763 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3c4e548b-f5ff-48fc-9d3e-d78f7ac120f3 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.131892 Jun 02 13:54:05.752657 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 14/18] 10.222.0.33 () {58 vars in 1148 bytes} [Thu Jun 2 13:54:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:54:05.759099 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ed2c2306-2f9b-498e-9fdd-7a4029161b82 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:05.759909 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ed2c2306-2f9b-498e-9fdd-7a4029161b82 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:05.967192 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ed2c2306-2f9b-498e-9fdd-7a4029161b82 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:05.978137 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ed2c2306-2f9b-498e-9fdd-7a4029161b82 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1214 microversion: 2.1 time: 0.223443 Jun 02 13:54:05.988864 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 15/19] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:05 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1214 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:05.995558 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c710049b-b28c-4f4f-9d21-dd1a500c3dda tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] Calling method '.version_select at 0x7fb7204b8d30>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:06.138617 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c710049b-b28c-4f4f-9d21-dd1a500c3dda tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.148201 Jun 02 13:54:06.139713 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 16/20] 10.222.0.33 () {58 vars in 1133 bytes} [Thu Jun 2 13:54:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:06.154400 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b288dc0f-ee7a-4e59-9336-aebae0b8e438 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] Calling method '.version_select at 0x7fb720cf99d0>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:06.244112 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Flavor limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:54:06.244577 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Image limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:54:06.245053 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Flavor pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:54:06.245521 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Image pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:54:06.259952 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:54:06.259952 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:06.259952 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:06.265095 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:06.265855 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:06.301760 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b288dc0f-ee7a-4e59-9336-aebae0b8e438 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.153913 Jun 02 13:54:06.302889 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 17/21] 10.222.0.33 () {58 vars in 1166 bytes} [Thu Jun 2 13:54:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:54:06.311198 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Getting quotas for project b067e3c448e24f179830992fecf65399. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:54:06.317861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-70a8e9d4-520b-4dfb-898e-612fe2f7d377 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] Calling method '.version_select at 0x7fb720440790>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:06.322008 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Getting quotas for user f9e57606c14a4ad99612414c1f9719f4 and project b067e3c448e24f179830992fecf65399. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:54:06.347473 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Going to run 1 instances... {{(pid=118315) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:54:06.350929 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118315) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:54:06.490794 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-70a8e9d4-520b-4dfb-898e-612fe2f7d377 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.177455 Jun 02 13:54:06.491662 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 18/22] 10.222.0.33 () {58 vars in 1169 bytes} [Thu Jun 2 13:54:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:54:06.505756 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-296caf1e-1ac1-4f0e-8728-bd0deb507263 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] Calling method '.version_select at 0x7fb720440820>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:06.594874 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-db78c007-b795-4f0b-81b5-20f73fc0437e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.844214 Jun 02 13:54:06.602265 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 5/23] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 13:54:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:54:06.611810 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-9f7f3c1e-a7b2-40b4-ba4a-831a79cd2279 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:06.614663 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-9f7f3c1e-a7b2-40b4-ba4a-831a79cd2279 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:06.741643 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-9f7f3c1e-a7b2-40b4-ba4a-831a79cd2279 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:06.749876 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-9f7f3c1e-a7b2-40b4-ba4a-831a79cd2279 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1222 microversion: 2.1 time: 0.146201 Jun 02 13:54:06.770960 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 6/24] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:06 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:06.780389 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-296caf1e-1ac1-4f0e-8728-bd0deb507263 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.278354 Jun 02 13:54:06.789763 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 19/25] 10.222.0.33 () {58 vars in 1154 bytes} [Thu Jun 2 13:54:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:06.795679 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3b35551e-73bc-49d5-938f-493fc4b13a92 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] Calling method '.version_select at 0x7fb7204b4940>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:06.998911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c370d9f5-6a4f-48f4-8a1d-0c4c8ffc7584 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:06.998911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c370d9f5-6a4f-48f4-8a1d-0c4c8ffc7584 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:07.008926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c370d9f5-6a4f-48f4-8a1d-0c4c8ffc7584 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:07.016952 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c370d9f5-6a4f-48f4-8a1d-0c4c8ffc7584 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:07.021666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c370d9f5-6a4f-48f4-8a1d-0c4c8ffc7584 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:07.026381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c370d9f5-6a4f-48f4-8a1d-0c4c8ffc7584 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:07.044456 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3b35551e-73bc-49d5-938f-493fc4b13a92 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.253342 Jun 02 13:54:07.045686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 7/26] 10.222.0.33 () {58 vars in 1187 bytes} [Thu Jun 2 13:54:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:54:07.059040 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1244f56a-bccb-4229-a703-d83bb354a1c2 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] Calling method '.version_select at 0x7fb720440550>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:07.259070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1244f56a-bccb-4229-a703-d83bb354a1c2 tempest-VolumesTestJSON-1374539749 tempest-VolumesTestJSON-1374539749-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.203784 Jun 02 13:54:07.259918 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 8/27] 10.222.0.33 () {58 vars in 1154 bytes} [Thu Jun 2 13:54:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:07.335611 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c370d9f5-6a4f-48f4-8a1d-0c4c8ffc7584 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:07.350682 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c370d9f5-6a4f-48f4-8a1d-0c4c8ffc7584 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1218 microversion: 2.1 time: 0.358820 Jun 02 13:54:07.355590 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 20/28] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:06 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1218 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:07.372492 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1912172356", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:07.489676 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.network.neutron [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] validate_networks() for [('d18c7729-7b7d-45e9-aff0-7bcd407a86fb', None, None, None, None, None)] {{(pid=118315) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:54:08.144988 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Flavor limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:54:08.145568 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Image limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:54:08.145885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Flavor pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:54:08.146290 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Image pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:54:08.146699 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:54:08.158917 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:08.159376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:08.160172 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:08.160678 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:08.177097 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Getting quotas for project b067e3c448e24f179830992fecf65399. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:54:08.202334 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Getting quotas for user f9e57606c14a4ad99612414c1f9719f4 and project b067e3c448e24f179830992fecf65399. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:54:08.222912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Going to run 1 instances... {{(pid=118315) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:54:08.225534 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118315) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:54:08.368688 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5a99b1af-a30b-4e23-b951-9eb3847070b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.001480 Jun 02 13:54:08.375225 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a59e549c-e922-4e04-8ad7-1fc8e8e9d889 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:08.375744 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 9/29] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 13:54:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:54:08.375847 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a59e549c-e922-4e04-8ad7-1fc8e8e9d889 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:08.383812 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-41c7ae13-b01a-4c21-b1f4-77ef616b6280 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:08.385043 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-41c7ae13-b01a-4c21-b1f4-77ef616b6280 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:08.385304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a59e549c-e922-4e04-8ad7-1fc8e8e9d889 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:08.386341 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a59e549c-e922-4e04-8ad7-1fc8e8e9d889 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:08.386558 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a59e549c-e922-4e04-8ad7-1fc8e8e9d889 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:08.386973 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a59e549c-e922-4e04-8ad7-1fc8e8e9d889 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:08.486099 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-41c7ae13-b01a-4c21-b1f4-77ef616b6280 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:08.494052 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-41c7ae13-b01a-4c21-b1f4-77ef616b6280 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1222 microversion: 2.1 time: 0.114631 Jun 02 13:54:08.513040 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 10/30] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:08 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:08.526677 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-220023432", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5559c4cf-ba93-4965-bd8e-405e569a88a3"}], "security_groups": [{"name": "tempest-securitygroup--147769450"}], "key_name": "tempest-keypair-1218029708", "user_data": "}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:08.572488 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a59e549c-e922-4e04-8ad7-1fc8e8e9d889 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:08.585353 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a59e549c-e922-4e04-8ad7-1fc8e8e9d889 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1266 microversion: 2.1 time: 0.216488 Jun 02 13:54:08.597302 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 21/31] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:08 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:08.774819 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.network.neutron [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] validate_networks() for [('5559c4cf-ba93-4965-bd8e-405e569a88a3', None, None, None, None, None)] {{(pid=118315) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:54:09.460737 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Flavor limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:54:09.461814 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Image limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:54:09.462441 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Flavor pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:54:09.463043 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Image pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:54:09.463659 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:54:09.474601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:09.475303 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:09.476280 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:09.477004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:09.505927 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Getting quotas for project 56c3f04e3f164a77b32b1e320d979863. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:54:09.519389 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Getting quotas for user 4dd10f5fa400450fb64360391a871bb8 and project 56c3f04e3f164a77b32b1e320d979863. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:54:09.521242 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2a17299c-7653-4084-a60d-f3c56096679f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:09.522566 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2a17299c-7653-4084-a60d-f3c56096679f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:09.547951 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Going to run 1 instances... {{(pid=118315) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:54:09.550169 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118315) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:54:09.616129 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2a17299c-7653-4084-a60d-f3c56096679f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:09.629689 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2a17299c-7653-4084-a60d-f3c56096679f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1222 microversion: 2.1 time: 0.115479 Jun 02 13:54:09.676830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 22/32] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:09 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:09.693559 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3aa25b2e-094a-49ac-86b0-299f0c932523 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:09.694188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3aa25b2e-094a-49ac-86b0-299f0c932523 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:09.710413 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3aa25b2e-094a-49ac-86b0-299f0c932523 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:09.710881 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3aa25b2e-094a-49ac-86b0-299f0c932523 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:09.713298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3aa25b2e-094a-49ac-86b0-299f0c932523 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:09.714012 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3aa25b2e-094a-49ac-86b0-299f0c932523 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:09.788161 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-03aa7156-ca35-4a0a-b557-1fa3badab40c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.273298 Jun 02 13:54:09.790693 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 11/33] 10.222.0.33 () {62 vars in 1187 bytes} [Thu Jun 2 13:54:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 02 13:54:09.804211 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1a82765d-3cca-4186-a139-92707d86ceb3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:09.805153 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1a82765d-3cca-4186-a139-92707d86ceb3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:09.900120 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3aa25b2e-094a-49ac-86b0-299f0c932523 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:09.915192 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3aa25b2e-094a-49ac-86b0-299f0c932523 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1272 microversion: 2.1 time: 0.233750 Jun 02 13:54:09.916110 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 23/34] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:09 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:10.113464 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1a82765d-3cca-4186-a139-92707d86ceb3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:10.117728 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1a82765d-3cca-4186-a139-92707d86ceb3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:10.119388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1a82765d-3cca-4186-a139-92707d86ceb3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:10.120849 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1a82765d-3cca-4186-a139-92707d86ceb3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1281 microversion: 2.20 time: 0.323248 Jun 02 13:54:10.132937 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 12/35] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:09 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1281 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:54:10.649421 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ce033ddd-ae12-4474-a0aa-59f21a63766e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:10.650688 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ce033ddd-ae12-4474-a0aa-59f21a63766e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:10.682198 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ce033ddd-ae12-4474-a0aa-59f21a63766e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:10.682763 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ce033ddd-ae12-4474-a0aa-59f21a63766e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:10.685827 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ce033ddd-ae12-4474-a0aa-59f21a63766e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:10.688253 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ce033ddd-ae12-4474-a0aa-59f21a63766e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:11.025031 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e9fa22d5-850b-47be-a1f9-69dce2ead155 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Action: 'create', calling method: .version_select at 0x7fb7204b8b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1720408402", "metadata": {"Type": "work"}}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e9fa22d5-850b-47be-a1f9-69dce2ead155 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Request method failure captured: Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 122 Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMECpUdmjsolBiAIkKFUE4HkQ3AOp5jQELUSlc8bk9Z7YQVje5md8jo33IVcB7jBu4bmrU9_lo8w9Spm5XHuqHKBpcsnmjhn-C-ELgZCxAMYFpDAo6SoGqoXgaL97maZCAqM5HG8WekD9z6u709JUNG6Tec_ZPoYgInQKKqbvwSf-hw Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 50b6aab73ea648b7870ac4bb1d6d079e Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 13:54:11.039276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 13:54:11.040518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:54:11.040518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.040518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 50b6aab73ea648b7870ac4bb1d6d079e Jun 02 13:54:11.040518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.040518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-VolumesNegativeTest-1579218464-project Jun 02 13:54:11.040518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 13:54:11.040518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 13:54:11.040518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: d1ae0b87306f4ed28a9460218c9058b4 Jun 02 13:54:11.040518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-VolumesNegativeTest-1579218464-project Jun 02 13:54:11.040518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Jun 02 13:54:11.040518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1720408402", "metadata": {"Type": "work"}}} Jun 02 13:54:11.040518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: Jun 02 13:54:11.040518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1720408402', 'metadata': {'Type': 'work'}}}} Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise error Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi '#$%' Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:54:11.041184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 13:54:11.042328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 13:54:11.043347 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 13:54:11.043347 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.043347 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e9fa22d5-850b-47be-a1f9-69dce2ead155 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:54:11.051869 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e9fa22d5-850b-47be-a1f9-69dce2ead155 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.727674 Jun 02 13:54:11.052491 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 24/36] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 2 13:54:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 729 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:54:11.070327 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a834360f-28c8-4a03-a5a8-0dc4c97f8e66 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:11.073218 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a834360f-28c8-4a03-a5a8-0dc4c97f8e66 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:11.101706 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a834360f-28c8-4a03-a5a8-0dc4c97f8e66 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:11.102256 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a834360f-28c8-4a03-a5a8-0dc4c97f8e66 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:11.103358 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a834360f-28c8-4a03-a5a8-0dc4c97f8e66 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:11.106837 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a834360f-28c8-4a03-a5a8-0dc4c97f8e66 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:11.242711 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ce033ddd-ae12-4474-a0aa-59f21a63766e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:11.258093 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ce033ddd-ae12-4474-a0aa-59f21a63766e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1218 microversion: 2.1 time: 0.613287 Jun 02 13:54:11.269704 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 13/37] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:10 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1218 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:11.275519 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-96eecfb6-3a7d-4a0e-af5d-32b9ce5d9cde tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Action: 'create', calling method: .version_select at 0x7fb72043c550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-253001723", "metadata": {"Type": "work"}}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-96eecfb6-3a7d-4a0e-af5d-32b9ce5d9cde tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Request method failure captured: Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 119 Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMECpUdmjsolBiAIkKFUE4HkQ3AOp5jQELUSlc8bk9Z7YQVje5md8jo33IVcB7jBu4bmrU9_lo8w9Spm5XHuqHKBpcsnmjhn-C-ELgZCxAMYFpDAo6SoGqoXgaL97maZCAqM5HG8WekD9z6u709JUNG6Tec_ZPoYgInQKKqbvwSf-hw Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 50b6aab73ea648b7870ac4bb1d6d079e Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 13:54:11.287105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 13:54:11.288660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:54:11.288660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.288660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 50b6aab73ea648b7870ac4bb1d6d079e Jun 02 13:54:11.288660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.288660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-VolumesNegativeTest-1579218464-project Jun 02 13:54:11.288660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 13:54:11.288660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 13:54:11.288660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: d1ae0b87306f4ed28a9460218c9058b4 Jun 02 13:54:11.288660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-VolumesNegativeTest-1579218464-project Jun 02 13:54:11.288660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Jun 02 13:54:11.288660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-253001723", "metadata": {"Type": "work"}}} Jun 02 13:54:11.288660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: Jun 02 13:54:11.288660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-253001723', 'metadata': {'Type': 'work'}}}} Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise error Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi '0' Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:54:11.289345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 13:54:11.291024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 13:54:11.292883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 13:54:11.292883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.292883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-96eecfb6-3a7d-4a0e-af5d-32b9ce5d9cde tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:54:11.292883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-96eecfb6-3a7d-4a0e-af5d-32b9ce5d9cde tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017931 Jun 02 13:54:11.294099 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 14/38] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 2 13:54:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:54:11.307457 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-8123c45b-d72c-4716-b130-4be062258b8c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:11.308086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-8123c45b-d72c-4716-b130-4be062258b8c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:11.446737 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-8123c45b-d72c-4716-b130-4be062258b8c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:11.453170 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-8123c45b-d72c-4716-b130-4be062258b8c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:11.462402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-8123c45b-d72c-4716-b130-4be062258b8c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:11.468364 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-8123c45b-d72c-4716-b130-4be062258b8c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1281 microversion: 2.20 time: 0.170440 Jun 02 13:54:11.470669 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 15/39] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:11 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:11.478977 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d7a0eb79-02ad-4e21-ae48-7ae1ff8c0046 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Action: 'create', calling method: .version_select at 0x7fb7203c8040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-268466459", "metadata": {"Type": "work"}}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d7a0eb79-02ad-4e21-ae48-7ae1ff8c0046 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Request method failure captured: Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 118 Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMECpUdmjsolBiAIkKFUE4HkQ3AOp5jQELUSlc8bk9Z7YQVje5md8jo33IVcB7jBu4bmrU9_lo8w9Spm5XHuqHKBpcsnmjhn-C-ELgZCxAMYFpDAo6SoGqoXgaL97maZCAqM5HG8WekD9z6u709JUNG6Tec_ZPoYgInQKKqbvwSf-hw Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 50b6aab73ea648b7870ac4bb1d6d079e Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 13:54:11.486782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 13:54:11.488210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:54:11.488210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.488210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 50b6aab73ea648b7870ac4bb1d6d079e Jun 02 13:54:11.488210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.488210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-VolumesNegativeTest-1579218464-project Jun 02 13:54:11.488210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 13:54:11.488210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 13:54:11.488210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: d1ae0b87306f4ed28a9460218c9058b4 Jun 02 13:54:11.488210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-VolumesNegativeTest-1579218464-project Jun 02 13:54:11.488210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Jun 02 13:54:11.488210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-268466459", "metadata": {"Type": "work"}}} Jun 02 13:54:11.488210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: Jun 02 13:54:11.488210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-268466459', 'metadata': {'Type': 'work'}}}} Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise error Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi '' Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:54:11.489106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 13:54:11.491433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 13:54:11.494525 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 13:54:11.494525 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.494525 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d7a0eb79-02ad-4e21-ae48-7ae1ff8c0046 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:54:11.494525 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d7a0eb79-02ad-4e21-ae48-7ae1ff8c0046 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015889 Jun 02 13:54:11.495951 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 16/40] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 2 13:54:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:54:11.507575 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-85a1d00a-61e1-42a8-8071-03041110a340 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Calling method '.version_select at 0x7fb7203ea790>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:11.559420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-85a1d00a-61e1-42a8-8071-03041110a340 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] HTTP exception thrown: Volume tempest-invalid-258147343 could not be found. Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-85a1d00a-61e1-42a8-8071-03041110a340 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Request method failure captured: Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-258147343 HTTP/1.1 Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMECpUdmjsolBiAIkKFUE4HkQ3AOp5jQELUSlc8bk9Z7YQVje5md8jo33IVcB7jBu4bmrU9_lo8w9Spm5XHuqHKBpcsnmjhn-C-ELgZCxAMYFpDAo6SoGqoXgaL97maZCAqM5HG8WekD9z6u709JUNG6Tec_ZPoYgInQKKqbvwSf-hw Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 50b6aab73ea648b7870ac4bb1d6d079e Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 13:54:11.564051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 13:54:11.565178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:54:11.565178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.565178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 50b6aab73ea648b7870ac4bb1d6d079e Jun 02 13:54:11.565178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.565178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-VolumesNegativeTest-1579218464-project Jun 02 13:54:11.565178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 13:54:11.565178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 13:54:11.565178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: d1ae0b87306f4ed28a9460218c9058b4 Jun 02 13:54:11.565178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-VolumesNegativeTest-1579218464-project Jun 02 13:54:11.565178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: Jun 02 13:54:11.565178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Volume tempest-invalid-258147343 could not be found. Jun 02 13:54:11.565178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': 'tempest-invalid-258147343'} Jun 02 13:54:11.565178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-258147343 could not be found. (HTTP 404) (Request-ID: req-08dbbb48-c0e8-4a7f-a1a4-632e38a27cfa) Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.565828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:54:11.566776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-258147343 could not be found. Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:54:11.567747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-258147343 could not be found. Jun 02 13:54:11.568749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.568749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.568749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.568749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.568749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:54:11.568749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:54:11.568749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:54:11.568749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:54:11.568749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-258147343 could not be found. Jun 02 13:54:11.568749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.570966 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-85a1d00a-61e1-42a8-8071-03041110a340 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Returning 404 to user: Volume tempest-invalid-258147343 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:54:11.572036 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-85a1d00a-61e1-42a8-8071-03041110a340 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-258147343" status: 404 len: 98 microversion: 2.1 time: 0.075068 Jun 02 13:54:11.572858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 17/41] 10.222.0.33 () {58 vars in 1214 bytes} [Thu Jun 2 13:54:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-258147343 => generated 98 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 02 13:54:11.586737 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e0998852-d426-4219-891f-ba9c76a19e02 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004680 Jun 02 13:54:11.588147 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 18/42] 10.222.0.33 () {58 vars in 1139 bytes} [Thu Jun 2 13:54:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 02 13:54:11.600018 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-119d72d1-b4be-427b-b138-02a9a280f1ab tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003964 Jun 02 13:54:11.601069 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 19/43] 10.222.0.33 () {58 vars in 1136 bytes} [Thu Jun 2 13:54:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 02 13:54:11.611955 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-07d5cdd4-f5e8-4657-ac7a-a964d20b71a7 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Calling method '.version_select at 0x7fb720440430>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:11.642869 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a834360f-28c8-4a03-a5a8-0dc4c97f8e66 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:11.646569 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-07d5cdd4-f5e8-4657-ac7a-a964d20b71a7 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] HTTP exception thrown: Volume 0f59a7dc-5d4e-493c-8eb0-6daa43324be6 could not be found. Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-07d5cdd4-f5e8-4657-ac7a-a964d20b71a7 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Request method failure captured: Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: DELETE /compute/v2.1/os-volumes/0f59a7dc-5d4e-493c-8eb0-6daa43324be6 HTTP/1.1 Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMECpUdmjsolBiAIkKFUE4HkQ3AOp5jQELUSlc8bk9Z7YQVje5md8jo33IVcB7jBu4bmrU9_lo8w9Spm5XHuqHKBpcsnmjhn-C-ELgZCxAMYFpDAo6SoGqoXgaL97maZCAqM5HG8WekD9z6u709JUNG6Tec_ZPoYgInQKKqbvwSf-hw Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 50b6aab73ea648b7870ac4bb1d6d079e Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 13:54:11.649486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 13:54:11.651149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:54:11.651149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.651149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 50b6aab73ea648b7870ac4bb1d6d079e Jun 02 13:54:11.651149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.651149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-VolumesNegativeTest-1579218464-project Jun 02 13:54:11.651149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 13:54:11.651149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 13:54:11.651149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: d1ae0b87306f4ed28a9460218c9058b4 Jun 02 13:54:11.651149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-VolumesNegativeTest-1579218464-project Jun 02 13:54:11.651149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: Jun 02 13:54:11.651149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Volume 0f59a7dc-5d4e-493c-8eb0-6daa43324be6 could not be found. Jun 02 13:54:11.651149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '0f59a7dc-5d4e-493c-8eb0-6daa43324be6'} Jun 02 13:54:11.651149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0f59a7dc-5d4e-493c-8eb0-6daa43324be6 could not be found. (HTTP 404) (Request-ID: req-38d54e81-e8bc-4eb2-a5b8-4da570172b23) Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.651882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:54:11.652832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0f59a7dc-5d4e-493c-8eb0-6daa43324be6 could not be found. Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 13:54:11.653750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:54:11.654700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0f59a7dc-5d4e-493c-8eb0-6daa43324be6 could not be found. Jun 02 13:54:11.654700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.654700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.654700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.654700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.654700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:54:11.654700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:54:11.654700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:54:11.654700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:54:11.654700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0f59a7dc-5d4e-493c-8eb0-6daa43324be6 could not be found. Jun 02 13:54:11.654700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.657204 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-07d5cdd4-f5e8-4657-ac7a-a964d20b71a7 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Returning 404 to user: Volume 0f59a7dc-5d4e-493c-8eb0-6daa43324be6 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:54:11.658353 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-07d5cdd4-f5e8-4657-ac7a-a964d20b71a7 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/0f59a7dc-5d4e-493c-8eb0-6daa43324be6" status: 404 len: 109 microversion: 2.1 time: 0.050403 Jun 02 13:54:11.659189 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 20/44] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 2 13:54:11 2022] DELETE /compute/v2.1/os-volumes/0f59a7dc-5d4e-493c-8eb0-6daa43324be6 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:54:11.681603 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0afd4259-1e5e-46bd-963f-626d05268b45 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Calling method '.version_select at 0x7fb72043ce50>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:11.713454 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a834360f-28c8-4a03-a5a8-0dc4c97f8e66 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.659878 Jun 02 13:54:11.733654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 25/45] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:11 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:11.784487 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-0afd4259-1e5e-46bd-963f-626d05268b45 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] HTTP exception thrown: Volume 36548520-22bf-4444-a26e-a4926c9ee035 could not be found. Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0afd4259-1e5e-46bd-963f-626d05268b45 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Request method failure captured: Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/os-volumes/36548520-22bf-4444-a26e-a4926c9ee035 HTTP/1.1 Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMECpUdmjsolBiAIkKFUE4HkQ3AOp5jQELUSlc8bk9Z7YQVje5md8jo33IVcB7jBu4bmrU9_lo8w9Spm5XHuqHKBpcsnmjhn-C-ELgZCxAMYFpDAo6SoGqoXgaL97maZCAqM5HG8WekD9z6u709JUNG6Tec_ZPoYgInQKKqbvwSf-hw Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 50b6aab73ea648b7870ac4bb1d6d079e Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 13:54:11.786431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 13:54:11.787586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/50b6aab73ea648b7870ac4bb1d6d079e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:54:11.787586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.787586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 50b6aab73ea648b7870ac4bb1d6d079e Jun 02 13:54:11.787586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-VolumesNegativeTest-1579218464 Jun 02 13:54:11.787586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-VolumesNegativeTest-1579218464-project Jun 02 13:54:11.787586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 13:54:11.787586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 13:54:11.787586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: d1ae0b87306f4ed28a9460218c9058b4 Jun 02 13:54:11.787586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-VolumesNegativeTest-1579218464-project Jun 02 13:54:11.787586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: Jun 02 13:54:11.787586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Volume 36548520-22bf-4444-a26e-a4926c9ee035 could not be found. Jun 02 13:54:11.787586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '36548520-22bf-4444-a26e-a4926c9ee035'} Jun 02 13:54:11.787586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36548520-22bf-4444-a26e-a4926c9ee035 could not be found. (HTTP 404) (Request-ID: req-69f0714d-ab47-486e-9f63-b2acb099ac7a) Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.788243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:54:11.793947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36548520-22bf-4444-a26e-a4926c9ee035 could not be found. Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 13:54:11.795613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:54:11.796558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36548520-22bf-4444-a26e-a4926c9ee035 could not be found. Jun 02 13:54:11.796558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.796558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:54:11.796558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.796558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:54:11.796558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:54:11.796558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:54:11.796558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:54:11.796558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:54:11.796558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36548520-22bf-4444-a26e-a4926c9ee035 could not be found. Jun 02 13:54:11.796558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:54:11.796558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0afd4259-1e5e-46bd-963f-626d05268b45 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] Returning 404 to user: Volume 36548520-22bf-4444-a26e-a4926c9ee035 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:54:11.796558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0afd4259-1e5e-46bd-963f-626d05268b45 tempest-VolumesNegativeTest-1579218464 tempest-VolumesNegativeTest-1579218464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/36548520-22bf-4444-a26e-a4926c9ee035" status: 404 len: 109 microversion: 2.1 time: 0.118695 Jun 02 13:54:11.796558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 21/46] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 13:54:11 2022] GET /compute/v2.1/os-volumes/36548520-22bf-4444-a26e-a4926c9ee035 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:54:12.278574 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-44841095-43f9-4f02-bcf8-18d85b3f5518 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:12.279745 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-44841095-43f9-4f02-bcf8-18d85b3f5518 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:12.302784 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44841095-43f9-4f02-bcf8-18d85b3f5518 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:12.303523 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44841095-43f9-4f02-bcf8-18d85b3f5518 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:12.306360 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44841095-43f9-4f02-bcf8-18d85b3f5518 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:12.308619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44841095-43f9-4f02-bcf8-18d85b3f5518 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:12.479603 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-44841095-43f9-4f02-bcf8-18d85b3f5518 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:12.498950 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7fc800cb-cdb4-4617-b570-5c9ba50da45b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:12.500150 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7fc800cb-cdb4-4617-b570-5c9ba50da45b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:12.504624 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-44841095-43f9-4f02-bcf8-18d85b3f5518 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1274 microversion: 2.1 time: 0.219697 Jun 02 13:54:12.523637 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 26/47] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:12 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1274 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:12.528207 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7fc800cb-cdb4-4617-b570-5c9ba50da45b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:12.529784 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7fc800cb-cdb4-4617-b570-5c9ba50da45b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:12.531021 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7fc800cb-cdb4-4617-b570-5c9ba50da45b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:12.531736 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7fc800cb-cdb4-4617-b570-5c9ba50da45b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:12.620773 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7fc800cb-cdb4-4617-b570-5c9ba50da45b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:12.632368 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7fc800cb-cdb4-4617-b570-5c9ba50da45b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:12.634316 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7fc800cb-cdb4-4617-b570-5c9ba50da45b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:12.635474 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7fc800cb-cdb4-4617-b570-5c9ba50da45b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1285 microversion: 2.20 time: 0.141878 Jun 02 13:54:12.636168 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 22/48] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:12 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:54:12.730977 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ba13ec89-b3c6-48ad-9acc-6c5bc2b1c85c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:12.732779 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ba13ec89-b3c6-48ad-9acc-6c5bc2b1c85c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:12.739807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ba13ec89-b3c6-48ad-9acc-6c5bc2b1c85c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:12.740437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ba13ec89-b3c6-48ad-9acc-6c5bc2b1c85c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:12.741209 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ba13ec89-b3c6-48ad-9acc-6c5bc2b1c85c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:12.741650 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ba13ec89-b3c6-48ad-9acc-6c5bc2b1c85c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:12.908863 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ba13ec89-b3c6-48ad-9acc-6c5bc2b1c85c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:12.924378 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ba13ec89-b3c6-48ad-9acc-6c5bc2b1c85c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.197441 Jun 02 13:54:12.936440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 27/49] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:12 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:13.522865 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-6fcbc51a-aa0b-4b4a-9ba1-72a95b89f3e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:13.523797 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-6fcbc51a-aa0b-4b4a-9ba1-72a95b89f3e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:13.532986 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6fcbc51a-aa0b-4b4a-9ba1-72a95b89f3e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:13.533465 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6fcbc51a-aa0b-4b4a-9ba1-72a95b89f3e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:13.534272 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6fcbc51a-aa0b-4b4a-9ba1-72a95b89f3e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:13.534723 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6fcbc51a-aa0b-4b4a-9ba1-72a95b89f3e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:13.661359 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-189d9469-c361-4793-bdba-f3ff36d884b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:13.661990 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-189d9469-c361-4793-bdba-f3ff36d884b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:13.693217 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-189d9469-c361-4793-bdba-f3ff36d884b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:13.700148 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-189d9469-c361-4793-bdba-f3ff36d884b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:13.704371 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-189d9469-c361-4793-bdba-f3ff36d884b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:13.706728 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-189d9469-c361-4793-bdba-f3ff36d884b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:13.743720 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6fcbc51a-aa0b-4b4a-9ba1-72a95b89f3e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:13.752091 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-6fcbc51a-aa0b-4b4a-9ba1-72a95b89f3e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1282 microversion: 2.1 time: 0.232920 Jun 02 13:54:13.780875 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 23/50] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:13 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1282 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:13.814667 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-189d9469-c361-4793-bdba-f3ff36d884b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:13.823250 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-189d9469-c361-4793-bdba-f3ff36d884b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:13.835232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-189d9469-c361-4793-bdba-f3ff36d884b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:13.835232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-189d9469-c361-4793-bdba-f3ff36d884b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1277 microversion: 2.20 time: 0.176367 Jun 02 13:54:13.835232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 28/51] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:13 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:13.950299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-24d8894c-0f3c-4692-ab06-220d595a2dca tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:13.957207 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-24d8894c-0f3c-4692-ab06-220d595a2dca tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:13.971212 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-24d8894c-0f3c-4692-ab06-220d595a2dca tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:13.979622 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-24d8894c-0f3c-4692-ab06-220d595a2dca tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:13.980312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-24d8894c-0f3c-4692-ab06-220d595a2dca tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:13.981066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-24d8894c-0f3c-4692-ab06-220d595a2dca tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:14.599684 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-24d8894c-0f3c-4692-ab06-220d595a2dca tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:14.612760 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-24d8894c-0f3c-4692-ab06-220d595a2dca tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.673899 Jun 02 13:54:14.617044 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 24/52] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:13 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:14.782442 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f45af9df-bcb9-42af-abbb-b89eb7677e3e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:14.783211 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f45af9df-bcb9-42af-abbb-b89eb7677e3e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:14.795840 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f45af9df-bcb9-42af-abbb-b89eb7677e3e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:14.797718 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f45af9df-bcb9-42af-abbb-b89eb7677e3e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:14.815304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f45af9df-bcb9-42af-abbb-b89eb7677e3e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:14.820266 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f45af9df-bcb9-42af-abbb-b89eb7677e3e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:14.858730 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5d1d67ca-2357-444f-be60-55dcff4b9f63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:14.859706 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5d1d67ca-2357-444f-be60-55dcff4b9f63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:14.864316 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:14.876106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5d1d67ca-2357-444f-be60-55dcff4b9f63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:14.886536 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5d1d67ca-2357-444f-be60-55dcff4b9f63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:14.888938 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5d1d67ca-2357-444f-be60-55dcff4b9f63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:14.890008 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5d1d67ca-2357-444f-be60-55dcff4b9f63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:15.269888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f45af9df-bcb9-42af-abbb-b89eb7677e3e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:15.291190 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f45af9df-bcb9-42af-abbb-b89eb7677e3e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1280 microversion: 2.1 time: 0.504580 Jun 02 13:54:15.293889 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 29/53] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:14 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1280 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:15.320367 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5d1d67ca-2357-444f-be60-55dcff4b9f63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:15.348753 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5d1d67ca-2357-444f-be60-55dcff4b9f63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:15.351829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5d1d67ca-2357-444f-be60-55dcff4b9f63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:15.355878 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5d1d67ca-2357-444f-be60-55dcff4b9f63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1341 microversion: 2.20 time: 0.502608 Jun 02 13:54:15.368164 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 25/54] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:14 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1341 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:54:15.634716 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-47813a11-c931-4dc6-9c30-eccba6b32266 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:15.635508 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-47813a11-c931-4dc6-9c30-eccba6b32266 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:15.651497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-47813a11-c931-4dc6-9c30-eccba6b32266 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:15.652829 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-47813a11-c931-4dc6-9c30-eccba6b32266 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:15.655298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-47813a11-c931-4dc6-9c30-eccba6b32266 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:15.660019 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-47813a11-c931-4dc6-9c30-eccba6b32266 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:16.131782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-47813a11-c931-4dc6-9c30-eccba6b32266 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:16.140251 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-47813a11-c931-4dc6-9c30-eccba6b32266 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.509992 Jun 02 13:54:16.144025 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 30/55] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:15 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:16.302773 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-6781b974-1ed3-4676-ac55-6a4eee48c953 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:16.304607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-6781b974-1ed3-4676-ac55-6a4eee48c953 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:16.320642 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6781b974-1ed3-4676-ac55-6a4eee48c953 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:16.321533 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6781b974-1ed3-4676-ac55-6a4eee48c953 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:16.322945 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6781b974-1ed3-4676-ac55-6a4eee48c953 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:16.323705 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6781b974-1ed3-4676-ac55-6a4eee48c953 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:16.399748 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6ba4d204-1566-4951-a230-11eb33f8c04a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:16.400452 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6ba4d204-1566-4951-a230-11eb33f8c04a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:16.416343 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6ba4d204-1566-4951-a230-11eb33f8c04a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:16.420000 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6ba4d204-1566-4951-a230-11eb33f8c04a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:16.426448 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6ba4d204-1566-4951-a230-11eb33f8c04a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:16.426448 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6ba4d204-1566-4951-a230-11eb33f8c04a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:16.594126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6781b974-1ed3-4676-ac55-6a4eee48c953 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:16.611265 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-6781b974-1ed3-4676-ac55-6a4eee48c953 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1280 microversion: 2.1 time: 0.314087 Jun 02 13:54:16.626714 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 26/56] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:16 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1280 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:16.642322 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6ba4d204-1566-4951-a230-11eb33f8c04a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:16.654454 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6ba4d204-1566-4951-a230-11eb33f8c04a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:16.667755 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6ba4d204-1566-4951-a230-11eb33f8c04a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:16.681361 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6ba4d204-1566-4951-a230-11eb33f8c04a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1339 microversion: 2.20 time: 0.297595 Jun 02 13:54:16.681361 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 31/57] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:16 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1339 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:17.165173 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2bb3d892-d2c3-4733-9aba-0ee0da1d27f2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:17.165173 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2bb3d892-d2c3-4733-9aba-0ee0da1d27f2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:17.174848 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2bb3d892-d2c3-4733-9aba-0ee0da1d27f2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:17.177004 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2bb3d892-d2c3-4733-9aba-0ee0da1d27f2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:17.177931 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2bb3d892-d2c3-4733-9aba-0ee0da1d27f2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:17.178631 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2bb3d892-d2c3-4733-9aba-0ee0da1d27f2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:17.218490 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-d635a42e-62de-4e65-bf3b-8d738515445c req-822eb4f2-5050-434d-92d0-e77585ec23a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478fcfd0-657e-41c0-b9f2-38f449129a3b", "tag": "96fe44df-3a9f-4a2e-937a-7e7f60525297"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:17.242281 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-d635a42e-62de-4e65-bf3b-8d738515445c req-822eb4f2-5050-434d-92d0-e77585ec23a8 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:17.244486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-d635a42e-62de-4e65-bf3b-8d738515445c req-822eb4f2-5050-434d-92d0-e77585ec23a8 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:17.281222 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-d635a42e-62de-4e65-bf3b-8d738515445c req-822eb4f2-5050-434d-92d0-e77585ec23a8 service nova] Creating event network-changed:96fe44df-3a9f-4a2e-937a-7e7f60525297 for instance 478fcfd0-657e-41c0-b9f2-38f449129a3b on hv-cinder-82651 Jun 02 13:54:17.282349 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-d635a42e-62de-4e65-bf3b-8d738515445c req-822eb4f2-5050-434d-92d0-e77585ec23a8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118315) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 02 13:54:17.284342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-99c88e35-3b1e-4bfb-80ef-ce7a75cbf400 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:17.284815 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-99c88e35-3b1e-4bfb-80ef-ce7a75cbf400 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:17.285801 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-99c88e35-3b1e-4bfb-80ef-ce7a75cbf400 None None] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:17.286296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-99c88e35-3b1e-4bfb-80ef-ce7a75cbf400 None None] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:17.332808 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.compute.rpcapi [None req-99c88e35-3b1e-4bfb-80ef-ce7a75cbf400 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 02 13:54:17.336703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-99c88e35-3b1e-4bfb-80ef-ce7a75cbf400 None None] Releasing lock "compute-rpcapi-router" {{(pid=118315) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 02 13:54:17.364891 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2bb3d892-d2c3-4733-9aba-0ee0da1d27f2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:17.373642 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2bb3d892-d2c3-4733-9aba-0ee0da1d27f2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.215484 Jun 02 13:54:17.375912 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 32/58] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:17 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:17.389388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-99c88e35-3b1e-4bfb-80ef-ce7a75cbf400 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.293533 Jun 02 13:54:17.390106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 27/59] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:54:17.644641 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fdf9f31a-d9eb-47a7-9232-1f9b3a51239e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:17.645580 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-fdf9f31a-d9eb-47a7-9232-1f9b3a51239e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:17.652221 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fdf9f31a-d9eb-47a7-9232-1f9b3a51239e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:17.652879 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fdf9f31a-d9eb-47a7-9232-1f9b3a51239e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:17.653871 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fdf9f31a-d9eb-47a7-9232-1f9b3a51239e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:17.654306 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fdf9f31a-d9eb-47a7-9232-1f9b3a51239e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:17.780758 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-45d4c629-0dfe-4582-be48-2057ccbd5d04 req-b9b3028f-f78b-4474-bc1c-41f2ff8cc869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5490e17-83da-4dfb-a31f-60d619f614be", "tag": "f147c0c8-1142-49a5-ab6f-3a7caee335c3"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:17.800226 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-45d4c629-0dfe-4582-be48-2057ccbd5d04 req-b9b3028f-f78b-4474-bc1c-41f2ff8cc869 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:17.802028 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-45d4c629-0dfe-4582-be48-2057ccbd5d04 req-b9b3028f-f78b-4474-bc1c-41f2ff8cc869 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:17.861681 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-45d4c629-0dfe-4582-be48-2057ccbd5d04 req-b9b3028f-f78b-4474-bc1c-41f2ff8cc869 service nova] Creating event network-changed:f147c0c8-1142-49a5-ab6f-3a7caee335c3 for instance b5490e17-83da-4dfb-a31f-60d619f614be on hv-cinder-82651 Jun 02 13:54:17.861681 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-45d4c629-0dfe-4582-be48-2057ccbd5d04 req-b9b3028f-f78b-4474-bc1c-41f2ff8cc869 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118316) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 02 13:54:17.861929 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-816f654c-7c8f-45a5-901e-08e1f50feef4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:17.862338 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-fdf9f31a-d9eb-47a7-9232-1f9b3a51239e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:17.863452 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-816f654c-7c8f-45a5-901e-08e1f50feef4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:17.865497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-816f654c-7c8f-45a5-901e-08e1f50feef4 None None] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:17.866278 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-816f654c-7c8f-45a5-901e-08e1f50feef4 None None] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:17.874516 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-fdf9f31a-d9eb-47a7-9232-1f9b3a51239e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.232487 Jun 02 13:54:17.876278 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 28/60] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:17 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:17.891485 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.compute.rpcapi [None req-816f654c-7c8f-45a5-901e-08e1f50feef4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 02 13:54:17.892478 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-816f654c-7c8f-45a5-901e-08e1f50feef4 None None] Releasing lock "compute-rpcapi-router" {{(pid=118316) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 02 13:54:17.893318 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3ee98798-1225-4e5c-af91-9d796cce5013 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:17.895811 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3ee98798-1225-4e5c-af91-9d796cce5013 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:17.916083 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3ee98798-1225-4e5c-af91-9d796cce5013 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:17.916952 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3ee98798-1225-4e5c-af91-9d796cce5013 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:17.917163 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-816f654c-7c8f-45a5-901e-08e1f50feef4 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.539895 Jun 02 13:54:17.917475 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3ee98798-1225-4e5c-af91-9d796cce5013 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:17.918027 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 33/61] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:54:17.920600 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3ee98798-1225-4e5c-af91-9d796cce5013 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:18.163506 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3ee98798-1225-4e5c-af91-9d796cce5013 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:18.173811 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3ee98798-1225-4e5c-af91-9d796cce5013 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:18.175795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3ee98798-1225-4e5c-af91-9d796cce5013 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:18.177184 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3ee98798-1225-4e5c-af91-9d796cce5013 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.299428 Jun 02 13:54:18.177816 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 29/62] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:17 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:18.392160 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3fa38bfa-32e9-4d77-b962-e83e5fab40a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:18.392868 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3fa38bfa-32e9-4d77-b962-e83e5fab40a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:18.400065 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3fa38bfa-32e9-4d77-b962-e83e5fab40a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:18.400474 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3fa38bfa-32e9-4d77-b962-e83e5fab40a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:18.400898 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3fa38bfa-32e9-4d77-b962-e83e5fab40a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:18.401404 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3fa38bfa-32e9-4d77-b962-e83e5fab40a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:18.584919 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3fa38bfa-32e9-4d77-b962-e83e5fab40a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:18.593314 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3fa38bfa-32e9-4d77-b962-e83e5fab40a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.206004 Jun 02 13:54:18.593891 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 34/63] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:18 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:18.893395 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-eb0169b9-e5a3-4bb9-bcce-bbe9c2f9ead5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:18.894229 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-eb0169b9-e5a3-4bb9-bcce-bbe9c2f9ead5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:18.900342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-eb0169b9-e5a3-4bb9-bcce-bbe9c2f9ead5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:18.903229 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-eb0169b9-e5a3-4bb9-bcce-bbe9c2f9ead5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:18.903229 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-eb0169b9-e5a3-4bb9-bcce-bbe9c2f9ead5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:18.903229 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-eb0169b9-e5a3-4bb9-bcce-bbe9c2f9ead5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:19.084071 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-eb0169b9-e5a3-4bb9-bcce-bbe9c2f9ead5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:19.093205 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-eb0169b9-e5a3-4bb9-bcce-bbe9c2f9ead5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.204623 Jun 02 13:54:19.093942 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 30/64] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:18 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:19.195644 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-160eb15c-b5d4-485b-b0f4-461ac6bf4ea6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:19.196276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-160eb15c-b5d4-485b-b0f4-461ac6bf4ea6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:19.202579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-160eb15c-b5d4-485b-b0f4-461ac6bf4ea6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:19.203025 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-160eb15c-b5d4-485b-b0f4-461ac6bf4ea6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:19.203776 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-160eb15c-b5d4-485b-b0f4-461ac6bf4ea6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:19.204209 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-160eb15c-b5d4-485b-b0f4-461ac6bf4ea6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:19.339070 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-160eb15c-b5d4-485b-b0f4-461ac6bf4ea6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:19.350603 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-160eb15c-b5d4-485b-b0f4-461ac6bf4ea6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:19.353119 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-160eb15c-b5d4-485b-b0f4-461ac6bf4ea6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:19.354952 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-160eb15c-b5d4-485b-b0f4-461ac6bf4ea6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.163084 Jun 02 13:54:19.355802 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 35/65] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:19 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:19.610886 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-87c0353c-7595-4043-a668-c06f215142a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:19.612074 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-87c0353c-7595-4043-a668-c06f215142a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:19.618296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-87c0353c-7595-4043-a668-c06f215142a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:19.618747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-87c0353c-7595-4043-a668-c06f215142a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:19.619674 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-87c0353c-7595-4043-a668-c06f215142a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:19.620110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-87c0353c-7595-4043-a668-c06f215142a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:19.767500 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-87c0353c-7595-4043-a668-c06f215142a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:19.776054 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-87c0353c-7595-4043-a668-c06f215142a9 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.169686 Jun 02 13:54:19.776809 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 31/66] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:19 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:20.114100 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-bd2a3f9b-1b00-4fd0-8e59-30e0b40b3762 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:20.114665 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-bd2a3f9b-1b00-4fd0-8e59-30e0b40b3762 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:20.116646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=10 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:20.124603 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bd2a3f9b-1b00-4fd0-8e59-30e0b40b3762 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:20.125551 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bd2a3f9b-1b00-4fd0-8e59-30e0b40b3762 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:20.126660 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bd2a3f9b-1b00-4fd0-8e59-30e0b40b3762 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:20.127248 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bd2a3f9b-1b00-4fd0-8e59-30e0b40b3762 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:20.268499 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-bd2a3f9b-1b00-4fd0-8e59-30e0b40b3762 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:20.276923 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-bd2a3f9b-1b00-4fd0-8e59-30e0b40b3762 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.165687 Jun 02 13:54:20.276923 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 36/67] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:20 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:20.383269 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-00b21b40-f2c5-475f-88eb-2f8a638751d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:20.384391 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-00b21b40-f2c5-475f-88eb-2f8a638751d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:20.397808 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00b21b40-f2c5-475f-88eb-2f8a638751d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:20.398125 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00b21b40-f2c5-475f-88eb-2f8a638751d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:20.400877 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00b21b40-f2c5-475f-88eb-2f8a638751d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:20.401364 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00b21b40-f2c5-475f-88eb-2f8a638751d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:20.553443 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-00b21b40-f2c5-475f-88eb-2f8a638751d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:20.565347 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-00b21b40-f2c5-475f-88eb-2f8a638751d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:20.568900 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-00b21b40-f2c5-475f-88eb-2f8a638751d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:20.570295 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-00b21b40-f2c5-475f-88eb-2f8a638751d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.200721 Jun 02 13:54:20.571357 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 32/68] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:20 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:20.797278 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-1c52ef96-fb35-4aae-931b-e6bff256690b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:20.799102 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-1c52ef96-fb35-4aae-931b-e6bff256690b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:20.805494 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1c52ef96-fb35-4aae-931b-e6bff256690b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:20.805951 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1c52ef96-fb35-4aae-931b-e6bff256690b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:20.806718 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1c52ef96-fb35-4aae-931b-e6bff256690b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:20.807210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1c52ef96-fb35-4aae-931b-e6bff256690b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:20.973809 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1c52ef96-fb35-4aae-931b-e6bff256690b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:20.981629 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-1c52ef96-fb35-4aae-931b-e6bff256690b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.190292 Jun 02 13:54:20.982771 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 37/69] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:20 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:21.294413 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-9a7f80ae-3543-4f61-a3cd-7194c49fcff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:21.296353 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-9a7f80ae-3543-4f61-a3cd-7194c49fcff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:21.306434 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9a7f80ae-3543-4f61-a3cd-7194c49fcff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:21.306434 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9a7f80ae-3543-4f61-a3cd-7194c49fcff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:21.306434 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9a7f80ae-3543-4f61-a3cd-7194c49fcff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:21.306434 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9a7f80ae-3543-4f61-a3cd-7194c49fcff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:21.452860 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=36 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:21.523337 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-9a7f80ae-3543-4f61-a3cd-7194c49fcff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:21.532139 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-9a7f80ae-3543-4f61-a3cd-7194c49fcff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.241757 Jun 02 13:54:21.535626 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 33/70] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:21 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:21.589643 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3572ac0c-993d-447e-9829-1cccb462bc45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:21.590253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3572ac0c-993d-447e-9829-1cccb462bc45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:21.597030 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3572ac0c-993d-447e-9829-1cccb462bc45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:21.597429 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3572ac0c-993d-447e-9829-1cccb462bc45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:21.598250 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3572ac0c-993d-447e-9829-1cccb462bc45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:21.598676 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3572ac0c-993d-447e-9829-1cccb462bc45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:21.793564 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3572ac0c-993d-447e-9829-1cccb462bc45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:21.797728 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:21.803487 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3572ac0c-993d-447e-9829-1cccb462bc45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:21.805041 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3572ac0c-993d-447e-9829-1cccb462bc45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:21.806359 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3572ac0c-993d-447e-9829-1cccb462bc45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.220787 Jun 02 13:54:21.807438 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 38/71] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:21 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:22.000333 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d29a7c15-b5b0-4fb3-9b76-4c676af0c417 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:22.000980 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d29a7c15-b5b0-4fb3-9b76-4c676af0c417 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:22.006949 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d29a7c15-b5b0-4fb3-9b76-4c676af0c417 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:22.007391 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d29a7c15-b5b0-4fb3-9b76-4c676af0c417 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:22.008144 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d29a7c15-b5b0-4fb3-9b76-4c676af0c417 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:22.008611 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d29a7c15-b5b0-4fb3-9b76-4c676af0c417 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:22.160124 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d29a7c15-b5b0-4fb3-9b76-4c676af0c417 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:22.167920 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d29a7c15-b5b0-4fb3-9b76-4c676af0c417 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.172448 Jun 02 13:54:22.168501 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 34/72] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:21 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:22.548749 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4cb7f2ec-10c3-4208-97b7-19c72dce4bca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:22.549366 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4cb7f2ec-10c3-4208-97b7-19c72dce4bca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:22.555393 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4cb7f2ec-10c3-4208-97b7-19c72dce4bca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:22.555842 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4cb7f2ec-10c3-4208-97b7-19c72dce4bca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:22.556647 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4cb7f2ec-10c3-4208-97b7-19c72dce4bca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:22.557245 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4cb7f2ec-10c3-4208-97b7-19c72dce4bca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:22.714235 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4cb7f2ec-10c3-4208-97b7-19c72dce4bca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:22.723098 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4cb7f2ec-10c3-4208-97b7-19c72dce4bca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.178331 Jun 02 13:54:22.723741 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 39/73] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:22 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:22.827350 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-cd7b5259-6d58-485f-a9af-489daf17a08a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:22.827904 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-cd7b5259-6d58-485f-a9af-489daf17a08a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:22.834210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cd7b5259-6d58-485f-a9af-489daf17a08a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:22.834721 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cd7b5259-6d58-485f-a9af-489daf17a08a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:22.835797 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cd7b5259-6d58-485f-a9af-489daf17a08a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:22.836580 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cd7b5259-6d58-485f-a9af-489daf17a08a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:23.123267 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-cd7b5259-6d58-485f-a9af-489daf17a08a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:23.131265 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-cd7b5259-6d58-485f-a9af-489daf17a08a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:23.132911 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-cd7b5259-6d58-485f-a9af-489daf17a08a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:23.133900 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-cd7b5259-6d58-485f-a9af-489daf17a08a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.312723 Jun 02 13:54:23.134446 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 35/74] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:22 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:23.185579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-32f78e6e-837a-48a5-b7aa-88f50568f75e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:23.186659 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-32f78e6e-837a-48a5-b7aa-88f50568f75e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:23.196898 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-32f78e6e-837a-48a5-b7aa-88f50568f75e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:23.198619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-32f78e6e-837a-48a5-b7aa-88f50568f75e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:23.199737 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-32f78e6e-837a-48a5-b7aa-88f50568f75e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:23.200179 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-32f78e6e-837a-48a5-b7aa-88f50568f75e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:23.418934 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-32f78e6e-837a-48a5-b7aa-88f50568f75e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:23.431162 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-32f78e6e-837a-48a5-b7aa-88f50568f75e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.249695 Jun 02 13:54:23.432445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 40/75] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:23 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:23.741092 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1ba376e9-cdd3-4195-abcd-94f97758a513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:23.741709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1ba376e9-cdd3-4195-abcd-94f97758a513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:23.748252 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1ba376e9-cdd3-4195-abcd-94f97758a513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:23.748776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1ba376e9-cdd3-4195-abcd-94f97758a513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:23.749540 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1ba376e9-cdd3-4195-abcd-94f97758a513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:23.749976 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1ba376e9-cdd3-4195-abcd-94f97758a513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:23.770617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=100 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:23.949597 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1ba376e9-cdd3-4195-abcd-94f97758a513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:23.958295 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1ba376e9-cdd3-4195-abcd-94f97758a513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.220939 Jun 02 13:54:23.964552 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 36/76] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:23 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:24.155915 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-08febf21-601a-4379-9332-721497f2c267 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:24.156654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-08febf21-601a-4379-9332-721497f2c267 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:24.166575 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:24.172949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-08febf21-601a-4379-9332-721497f2c267 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:24.173645 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-08febf21-601a-4379-9332-721497f2c267 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:24.174604 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-08febf21-601a-4379-9332-721497f2c267 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:24.176489 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-08febf21-601a-4379-9332-721497f2c267 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:24.350313 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-08febf21-601a-4379-9332-721497f2c267 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:24.361237 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-08febf21-601a-4379-9332-721497f2c267 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:24.363020 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-08febf21-601a-4379-9332-721497f2c267 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:24.364435 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-08febf21-601a-4379-9332-721497f2c267 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.214827 Jun 02 13:54:24.365204 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 41/77] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:24 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:24.449511 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-bd520974-9f0c-49d5-905e-a17b51c2f48b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:24.450169 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-bd520974-9f0c-49d5-905e-a17b51c2f48b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:24.456991 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd520974-9f0c-49d5-905e-a17b51c2f48b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:24.457653 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd520974-9f0c-49d5-905e-a17b51c2f48b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:24.458421 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd520974-9f0c-49d5-905e-a17b51c2f48b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:24.458854 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd520974-9f0c-49d5-905e-a17b51c2f48b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:24.614616 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-bd520974-9f0c-49d5-905e-a17b51c2f48b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:24.622326 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-bd520974-9f0c-49d5-905e-a17b51c2f48b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.177361 Jun 02 13:54:24.627872 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 37/78] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:24 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:24.975831 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3d404f9b-f1bc-46a2-89fa-2eb4db34c630 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:24.976638 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3d404f9b-f1bc-46a2-89fa-2eb4db34c630 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:24.993451 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3d404f9b-f1bc-46a2-89fa-2eb4db34c630 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:24.993451 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3d404f9b-f1bc-46a2-89fa-2eb4db34c630 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:25.006669 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3d404f9b-f1bc-46a2-89fa-2eb4db34c630 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:25.007331 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3d404f9b-f1bc-46a2-89fa-2eb4db34c630 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:25.350313 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3d404f9b-f1bc-46a2-89fa-2eb4db34c630 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:25.363345 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3d404f9b-f1bc-46a2-89fa-2eb4db34c630 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.391981 Jun 02 13:54:25.363942 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 42/79] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:24 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:25.385417 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-45ea0650-5d3a-4e1f-9656-9d2623e230a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:25.386295 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-45ea0650-5d3a-4e1f-9656-9d2623e230a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:25.406722 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-45ea0650-5d3a-4e1f-9656-9d2623e230a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:25.407174 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-45ea0650-5d3a-4e1f-9656-9d2623e230a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:25.408072 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-45ea0650-5d3a-4e1f-9656-9d2623e230a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:25.408527 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-45ea0650-5d3a-4e1f-9656-9d2623e230a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:25.644149 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-897ad6c8-44fb-4b61-886b-f0f25aec31ee tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:25.647951 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-45ea0650-5d3a-4e1f-9656-9d2623e230a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:25.648807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-897ad6c8-44fb-4b61-886b-f0f25aec31ee tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:25.656777 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-45ea0650-5d3a-4e1f-9656-9d2623e230a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:25.660281 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-45ea0650-5d3a-4e1f-9656-9d2623e230a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:25.660281 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-45ea0650-5d3a-4e1f-9656-9d2623e230a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.278958 Jun 02 13:54:25.661040 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 38/80] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:25 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:25.674940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-897ad6c8-44fb-4b61-886b-f0f25aec31ee tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:25.681383 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-897ad6c8-44fb-4b61-886b-f0f25aec31ee tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:25.684055 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-897ad6c8-44fb-4b61-886b-f0f25aec31ee tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:25.688514 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-897ad6c8-44fb-4b61-886b-f0f25aec31ee tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:25.982594 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-897ad6c8-44fb-4b61-886b-f0f25aec31ee tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:25.992383 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-897ad6c8-44fb-4b61-886b-f0f25aec31ee tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.354645 Jun 02 13:54:26.002308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 43/81] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:25 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:26.384434 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d9807b47-a0a4-47ce-af8d-456f8f57d5fa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:26.385058 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d9807b47-a0a4-47ce-af8d-456f8f57d5fa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:26.396588 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d9807b47-a0a4-47ce-af8d-456f8f57d5fa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:26.401161 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d9807b47-a0a4-47ce-af8d-456f8f57d5fa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:26.402029 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d9807b47-a0a4-47ce-af8d-456f8f57d5fa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:26.402395 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d9807b47-a0a4-47ce-af8d-456f8f57d5fa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:26.600991 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d9807b47-a0a4-47ce-af8d-456f8f57d5fa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:26.609708 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d9807b47-a0a4-47ce-af8d-456f8f57d5fa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.229973 Jun 02 13:54:26.610984 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 39/82] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:26 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:26.679872 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-cdf9374c-2c73-4316-a01a-e5a334ef23e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:26.681192 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-cdf9374c-2c73-4316-a01a-e5a334ef23e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:26.689098 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cdf9374c-2c73-4316-a01a-e5a334ef23e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:26.689542 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cdf9374c-2c73-4316-a01a-e5a334ef23e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:26.690414 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cdf9374c-2c73-4316-a01a-e5a334ef23e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:26.690917 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cdf9374c-2c73-4316-a01a-e5a334ef23e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:26.871813 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-cdf9374c-2c73-4316-a01a-e5a334ef23e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:26.883065 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-cdf9374c-2c73-4316-a01a-e5a334ef23e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:26.884821 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-cdf9374c-2c73-4316-a01a-e5a334ef23e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:26.886144 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-cdf9374c-2c73-4316-a01a-e5a334ef23e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.210004 Jun 02 13:54:26.896937 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 44/83] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:26 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:27.011417 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4ecb848c-650e-413f-a575-ad479144754a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:27.019776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4ecb848c-650e-413f-a575-ad479144754a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:27.026298 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4ecb848c-650e-413f-a575-ad479144754a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:27.026931 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4ecb848c-650e-413f-a575-ad479144754a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:27.027988 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4ecb848c-650e-413f-a575-ad479144754a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:27.028635 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4ecb848c-650e-413f-a575-ad479144754a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:27.251869 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4ecb848c-650e-413f-a575-ad479144754a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:27.270026 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4ecb848c-650e-413f-a575-ad479144754a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.263658 Jun 02 13:54:27.283768 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 40/84] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:27 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:27.629233 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-fe5892b7-edef-4382-8df8-8130396839e9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:27.630009 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-fe5892b7-edef-4382-8df8-8130396839e9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:27.638410 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe5892b7-edef-4382-8df8-8130396839e9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:27.639094 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe5892b7-edef-4382-8df8-8130396839e9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:27.640205 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe5892b7-edef-4382-8df8-8130396839e9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:27.641571 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe5892b7-edef-4382-8df8-8130396839e9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:27.780931 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-fe5892b7-edef-4382-8df8-8130396839e9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:27.791094 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-fe5892b7-edef-4382-8df8-8130396839e9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.165995 Jun 02 13:54:27.791709 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 45/85] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:27 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:27.904116 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2500af3c-5544-4872-8ffb-0d9c2272e76c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:27.905970 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-2500af3c-5544-4872-8ffb-0d9c2272e76c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:27.908176 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=10 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:27.913357 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2500af3c-5544-4872-8ffb-0d9c2272e76c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:27.914047 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2500af3c-5544-4872-8ffb-0d9c2272e76c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:27.915141 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2500af3c-5544-4872-8ffb-0d9c2272e76c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:27.915582 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2500af3c-5544-4872-8ffb-0d9c2272e76c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:28.094406 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2500af3c-5544-4872-8ffb-0d9c2272e76c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:28.103858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2500af3c-5544-4872-8ffb-0d9c2272e76c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:28.111322 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2500af3c-5544-4872-8ffb-0d9c2272e76c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:28.115315 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2500af3c-5544-4872-8ffb-0d9c2272e76c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.212183 Jun 02 13:54:28.115315 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 41/86] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:27 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:28.293823 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-65659419-1670-475a-8018-00780d4e6ee3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:28.295522 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-65659419-1670-475a-8018-00780d4e6ee3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:28.297690 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:28.303339 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-65659419-1670-475a-8018-00780d4e6ee3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:28.303889 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-65659419-1670-475a-8018-00780d4e6ee3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:28.304919 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-65659419-1670-475a-8018-00780d4e6ee3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:28.319854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-65659419-1670-475a-8018-00780d4e6ee3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:28.525034 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-65659419-1670-475a-8018-00780d4e6ee3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:28.531523 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-65659419-1670-475a-8018-00780d4e6ee3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.241811 Jun 02 13:54:28.532100 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 46/87] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:28 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:28.809344 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-764a2a76-c6e0-4a86-92e6-0ceaa0ab88a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:28.810024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-764a2a76-c6e0-4a86-92e6-0ceaa0ab88a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:28.817779 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-764a2a76-c6e0-4a86-92e6-0ceaa0ab88a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:28.818228 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-764a2a76-c6e0-4a86-92e6-0ceaa0ab88a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:28.818982 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-764a2a76-c6e0-4a86-92e6-0ceaa0ab88a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:28.819413 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-764a2a76-c6e0-4a86-92e6-0ceaa0ab88a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:29.004633 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-764a2a76-c6e0-4a86-92e6-0ceaa0ab88a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:29.014934 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-764a2a76-c6e0-4a86-92e6-0ceaa0ab88a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.209615 Jun 02 13:54:29.023975 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 42/88] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:28 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:29.131491 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-beef0aba-3ac2-4bd4-b8de-6f9e74008c14 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:29.132423 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-beef0aba-3ac2-4bd4-b8de-6f9e74008c14 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:29.139404 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-beef0aba-3ac2-4bd4-b8de-6f9e74008c14 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:29.139856 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-beef0aba-3ac2-4bd4-b8de-6f9e74008c14 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:29.140725 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-beef0aba-3ac2-4bd4-b8de-6f9e74008c14 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:29.141401 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-beef0aba-3ac2-4bd4-b8de-6f9e74008c14 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:29.274383 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-beef0aba-3ac2-4bd4-b8de-6f9e74008c14 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:29.282744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-beef0aba-3ac2-4bd4-b8de-6f9e74008c14 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:29.284367 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-beef0aba-3ac2-4bd4-b8de-6f9e74008c14 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:29.285569 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-beef0aba-3ac2-4bd4-b8de-6f9e74008c14 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.158045 Jun 02 13:54:29.286216 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 47/89] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:29 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:29.551009 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4f71a272-9a2d-4ca7-a9c8-62cb5df0043f tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:29.551761 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4f71a272-9a2d-4ca7-a9c8-62cb5df0043f tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:29.558035 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4f71a272-9a2d-4ca7-a9c8-62cb5df0043f tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:29.558553 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4f71a272-9a2d-4ca7-a9c8-62cb5df0043f tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:29.559422 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4f71a272-9a2d-4ca7-a9c8-62cb5df0043f tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:29.559966 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4f71a272-9a2d-4ca7-a9c8-62cb5df0043f tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:29.701994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4f71a272-9a2d-4ca7-a9c8-62cb5df0043f tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:29.709515 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4f71a272-9a2d-4ca7-a9c8-62cb5df0043f tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.162462 Jun 02 13:54:29.710074 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 43/90] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:29 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:30.031883 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-10d8a414-a90c-489a-9a84-6e34b7b41595 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:30.032721 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-10d8a414-a90c-489a-9a84-6e34b7b41595 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:30.038928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-10d8a414-a90c-489a-9a84-6e34b7b41595 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:30.039453 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-10d8a414-a90c-489a-9a84-6e34b7b41595 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:30.040292 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-10d8a414-a90c-489a-9a84-6e34b7b41595 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:30.040832 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-10d8a414-a90c-489a-9a84-6e34b7b41595 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:30.247758 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-10d8a414-a90c-489a-9a84-6e34b7b41595 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:30.259327 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-10d8a414-a90c-489a-9a84-6e34b7b41595 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.231853 Jun 02 13:54:30.260125 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 48/91] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:30 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:30.304253 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d240683e-3d15-4dc7-b9a8-d2704d242b90 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:30.305091 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d240683e-3d15-4dc7-b9a8-d2704d242b90 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:30.313096 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d240683e-3d15-4dc7-b9a8-d2704d242b90 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:30.313544 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d240683e-3d15-4dc7-b9a8-d2704d242b90 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:30.314309 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d240683e-3d15-4dc7-b9a8-d2704d242b90 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:30.314738 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d240683e-3d15-4dc7-b9a8-d2704d242b90 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:30.567316 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d240683e-3d15-4dc7-b9a8-d2704d242b90 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:30.580077 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d240683e-3d15-4dc7-b9a8-d2704d242b90 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:30.585331 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d240683e-3d15-4dc7-b9a8-d2704d242b90 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:30.586493 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d240683e-3d15-4dc7-b9a8-d2704d242b90 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.286097 Jun 02 13:54:30.589330 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 44/92] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:30 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:30.727165 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3660f752-40b4-4396-b487-ed4861ee90d3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:30.727775 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3660f752-40b4-4396-b487-ed4861ee90d3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:30.735054 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3660f752-40b4-4396-b487-ed4861ee90d3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:30.735497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3660f752-40b4-4396-b487-ed4861ee90d3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:30.736594 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3660f752-40b4-4396-b487-ed4861ee90d3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:30.737114 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3660f752-40b4-4396-b487-ed4861ee90d3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:31.014724 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3660f752-40b4-4396-b487-ed4861ee90d3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:31.037387 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3660f752-40b4-4396-b487-ed4861ee90d3 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.307914 Jun 02 13:54:31.044132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 49/93] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:30 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:31.284918 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-8f35efe3-022d-4071-adff-1f743d7ec15a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:31.285986 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-8f35efe3-022d-4071-adff-1f743d7ec15a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:31.293262 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8f35efe3-022d-4071-adff-1f743d7ec15a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:31.293975 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8f35efe3-022d-4071-adff-1f743d7ec15a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:31.295638 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8f35efe3-022d-4071-adff-1f743d7ec15a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:31.296849 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8f35efe3-022d-4071-adff-1f743d7ec15a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:31.507339 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-8f35efe3-022d-4071-adff-1f743d7ec15a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:31.526386 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-8f35efe3-022d-4071-adff-1f743d7ec15a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.243118 Jun 02 13:54:31.528575 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 45/94] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:31 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:31.611074 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ef3db86e-a3e0-4297-b1a9-e2beca9a5690 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:31.611573 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ef3db86e-a3e0-4297-b1a9-e2beca9a5690 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:31.618826 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ef3db86e-a3e0-4297-b1a9-e2beca9a5690 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:31.619959 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ef3db86e-a3e0-4297-b1a9-e2beca9a5690 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:31.620947 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ef3db86e-a3e0-4297-b1a9-e2beca9a5690 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:31.621598 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ef3db86e-a3e0-4297-b1a9-e2beca9a5690 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:31.804354 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-df41404d-3c00-4d11-a79f-c4134125f112 req-7149df3e-241a-4bd3-95f6-c625a32a6a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d462ae-af14-4d5d-aab2-f45954429480", "tag": "9494633c-b230-4406-ab57-d1f3d39fc4d6"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:31.823842 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-df41404d-3c00-4d11-a79f-c4134125f112 req-7149df3e-241a-4bd3-95f6-c625a32a6a97 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:31.827824 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-df41404d-3c00-4d11-a79f-c4134125f112 req-7149df3e-241a-4bd3-95f6-c625a32a6a97 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:31.860727 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-df41404d-3c00-4d11-a79f-c4134125f112 req-7149df3e-241a-4bd3-95f6-c625a32a6a97 service nova] Creating event network-changed:9494633c-b230-4406-ab57-d1f3d39fc4d6 for instance 83d462ae-af14-4d5d-aab2-f45954429480 on hv-cinder-82651 Jun 02 13:54:31.881515 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-df41404d-3c00-4d11-a79f-c4134125f112 req-7149df3e-241a-4bd3-95f6-c625a32a6a97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074942 Jun 02 13:54:31.884709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 46/95] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:54:32.018803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ef3db86e-a3e0-4297-b1a9-e2beca9a5690 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:32.032856 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ef3db86e-a3e0-4297-b1a9-e2beca9a5690 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:32.034522 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ef3db86e-a3e0-4297-b1a9-e2beca9a5690 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:32.035652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ef3db86e-a3e0-4297-b1a9-e2beca9a5690 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.429810 Jun 02 13:54:32.036614 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 50/96] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:31 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:32.058979 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a425184d-1712-4683-b172-e7cb3a22784e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:32.059907 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a425184d-1712-4683-b172-e7cb3a22784e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:32.068429 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a425184d-1712-4683-b172-e7cb3a22784e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:32.069601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a425184d-1712-4683-b172-e7cb3a22784e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:32.070628 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a425184d-1712-4683-b172-e7cb3a22784e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:32.071123 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a425184d-1712-4683-b172-e7cb3a22784e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:32.263969 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a425184d-1712-4683-b172-e7cb3a22784e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:32.273774 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a425184d-1712-4683-b172-e7cb3a22784e tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.220105 Jun 02 13:54:32.274345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 47/97] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:32 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:32.546682 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4f28cd84-e039-484e-8dab-8bb68225b948 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:32.548024 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4f28cd84-e039-484e-8dab-8bb68225b948 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:32.562898 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4f28cd84-e039-484e-8dab-8bb68225b948 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:32.563830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4f28cd84-e039-484e-8dab-8bb68225b948 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:32.565271 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4f28cd84-e039-484e-8dab-8bb68225b948 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:32.565708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4f28cd84-e039-484e-8dab-8bb68225b948 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:32.836021 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4f28cd84-e039-484e-8dab-8bb68225b948 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:32.844923 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4f28cd84-e039-484e-8dab-8bb68225b948 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.302800 Jun 02 13:54:32.854378 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 51/98] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:32 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:33.054752 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-bd3fb1cd-3d77-43a3-bed0-f30bfd34c081 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:33.055363 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-bd3fb1cd-3d77-43a3-bed0-f30bfd34c081 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:33.096127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd3fb1cd-3d77-43a3-bed0-f30bfd34c081 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:33.096127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd3fb1cd-3d77-43a3-bed0-f30bfd34c081 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:33.096127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd3fb1cd-3d77-43a3-bed0-f30bfd34c081 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:33.096127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd3fb1cd-3d77-43a3-bed0-f30bfd34c081 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:33.216689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-bd3fb1cd-3d77-43a3-bed0-f30bfd34c081 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:33.225717 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-bd3fb1cd-3d77-43a3-bed0-f30bfd34c081 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:33.227300 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-bd3fb1cd-3d77-43a3-bed0-f30bfd34c081 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:33.228418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-bd3fb1cd-3d77-43a3-bed0-f30bfd34c081 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.177572 Jun 02 13:54:33.229330 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 48/99] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:33 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:33.294025 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b75094ec-659c-4c18-8aab-e73e4f7f268c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:33.294765 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b75094ec-659c-4c18-8aab-e73e4f7f268c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:33.302324 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b75094ec-659c-4c18-8aab-e73e4f7f268c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:33.302895 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b75094ec-659c-4c18-8aab-e73e4f7f268c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:33.303850 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b75094ec-659c-4c18-8aab-e73e4f7f268c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:33.304463 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b75094ec-659c-4c18-8aab-e73e4f7f268c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:33.435393 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b75094ec-659c-4c18-8aab-e73e4f7f268c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:33.442955 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b75094ec-659c-4c18-8aab-e73e4f7f268c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.153832 Jun 02 13:54:33.443535 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 52/100] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:33 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:33.862732 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1fa63248-20b5-4db4-a722-30da118fa29c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:33.863402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1fa63248-20b5-4db4-a722-30da118fa29c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:33.874564 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1fa63248-20b5-4db4-a722-30da118fa29c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:33.878190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1fa63248-20b5-4db4-a722-30da118fa29c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:33.879092 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1fa63248-20b5-4db4-a722-30da118fa29c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:33.879571 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1fa63248-20b5-4db4-a722-30da118fa29c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:33.913485 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-0b08b212-04ec-4121-af6d-0ccafb1486fd req-7ad7498e-4b80-4511-84bf-66a6e139425e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4ee4c28-6107-46d9-8461-8fcbd382c245", "tag": "5133c089-5826-4ecd-ac3b-a6905f94a47a"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:33.934859 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-0b08b212-04ec-4121-af6d-0ccafb1486fd req-7ad7498e-4b80-4511-84bf-66a6e139425e service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:33.935796 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-0b08b212-04ec-4121-af6d-0ccafb1486fd req-7ad7498e-4b80-4511-84bf-66a6e139425e service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:33.948947 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-0b08b212-04ec-4121-af6d-0ccafb1486fd req-7ad7498e-4b80-4511-84bf-66a6e139425e service nova] Creating event network-changed:5133c089-5826-4ecd-ac3b-a6905f94a47a for instance f4ee4c28-6107-46d9-8461-8fcbd382c245 on hv-cinder-82651 Jun 02 13:54:33.955316 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-0b08b212-04ec-4121-af6d-0ccafb1486fd req-7ad7498e-4b80-4511-84bf-66a6e139425e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046073 Jun 02 13:54:33.956702 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 53/101] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:54:34.140283 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1fa63248-20b5-4db4-a722-30da118fa29c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:34.149148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1fa63248-20b5-4db4-a722-30da118fa29c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.291245 Jun 02 13:54:34.149744 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 49/102] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:33 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:34.254226 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b2ddeb0a-ab4f-4dd8-b618-53ba1aa4a035 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:34.254927 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b2ddeb0a-ab4f-4dd8-b618-53ba1aa4a035 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:34.273657 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b2ddeb0a-ab4f-4dd8-b618-53ba1aa4a035 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:34.274114 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b2ddeb0a-ab4f-4dd8-b618-53ba1aa4a035 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:34.274937 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b2ddeb0a-ab4f-4dd8-b618-53ba1aa4a035 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:34.275299 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b2ddeb0a-ab4f-4dd8-b618-53ba1aa4a035 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:34.431051 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b2ddeb0a-ab4f-4dd8-b618-53ba1aa4a035 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:34.461301 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b2ddeb0a-ab4f-4dd8-b618-53ba1aa4a035 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:34.462940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b2ddeb0a-ab4f-4dd8-b618-53ba1aa4a035 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:34.464251 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b2ddeb0a-ab4f-4dd8-b618-53ba1aa4a035 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.214219 Jun 02 13:54:34.465116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 54/103] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:34 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:34.467739 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-722d2e2f-9dde-4dfe-b957-356dd51958cf tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:34.472250 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-722d2e2f-9dde-4dfe-b957-356dd51958cf tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:34.483088 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-722d2e2f-9dde-4dfe-b957-356dd51958cf tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:34.483609 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-722d2e2f-9dde-4dfe-b957-356dd51958cf tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:34.484524 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-722d2e2f-9dde-4dfe-b957-356dd51958cf tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:34.485628 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-722d2e2f-9dde-4dfe-b957-356dd51958cf tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:34.703930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-722d2e2f-9dde-4dfe-b957-356dd51958cf tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:34.711562 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-722d2e2f-9dde-4dfe-b957-356dd51958cf tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.253285 Jun 02 13:54:34.712133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 50/104] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:34 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:35.168437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4acad27a-8cd2-4861-ae4d-66755d4c606b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:35.169059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4acad27a-8cd2-4861-ae4d-66755d4c606b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:35.175143 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4acad27a-8cd2-4861-ae4d-66755d4c606b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:35.175596 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4acad27a-8cd2-4861-ae4d-66755d4c606b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:35.176342 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4acad27a-8cd2-4861-ae4d-66755d4c606b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:35.176800 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4acad27a-8cd2-4861-ae4d-66755d4c606b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:35.321138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4acad27a-8cd2-4861-ae4d-66755d4c606b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:35.337766 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4acad27a-8cd2-4861-ae4d-66755d4c606b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.173068 Jun 02 13:54:35.338345 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 55/105] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:35 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:35.484143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-6b16fe0c-d5f8-4940-acf9-d16f0a4ccd77 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:35.485286 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-6b16fe0c-d5f8-4940-acf9-d16f0a4ccd77 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:35.495989 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6b16fe0c-d5f8-4940-acf9-d16f0a4ccd77 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:35.496626 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6b16fe0c-d5f8-4940-acf9-d16f0a4ccd77 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:35.497770 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6b16fe0c-d5f8-4940-acf9-d16f0a4ccd77 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:35.498548 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6b16fe0c-d5f8-4940-acf9-d16f0a4ccd77 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:35.728461 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5d4b30f4-1133-46da-ab9a-76454b753e92 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:35.729086 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-5d4b30f4-1133-46da-ab9a-76454b753e92 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:35.739888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5d4b30f4-1133-46da-ab9a-76454b753e92 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:35.740343 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5d4b30f4-1133-46da-ab9a-76454b753e92 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:35.745398 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5d4b30f4-1133-46da-ab9a-76454b753e92 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:35.749006 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5d4b30f4-1133-46da-ab9a-76454b753e92 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:35.752214 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6b16fe0c-d5f8-4940-acf9-d16f0a4ccd77 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:35.761663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:35.786936 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6b16fe0c-d5f8-4940-acf9-d16f0a4ccd77 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:35.790585 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6b16fe0c-d5f8-4940-acf9-d16f0a4ccd77 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:35.794045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-6b16fe0c-d5f8-4940-acf9-d16f0a4ccd77 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.314635 Jun 02 13:54:35.795992 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 51/106] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:35 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:35.963434 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5d4b30f4-1133-46da-ab9a-76454b753e92 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:35.973665 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5d4b30f4-1133-46da-ab9a-76454b753e92 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.249148 Jun 02 13:54:35.974774 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 56/107] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:35 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:36.356612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a9fdf21c-c76d-4814-85df-703ab58bfe48 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:36.357910 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a9fdf21c-c76d-4814-85df-703ab58bfe48 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:36.369285 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a9fdf21c-c76d-4814-85df-703ab58bfe48 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:36.369451 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a9fdf21c-c76d-4814-85df-703ab58bfe48 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:36.370465 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a9fdf21c-c76d-4814-85df-703ab58bfe48 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:36.370961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a9fdf21c-c76d-4814-85df-703ab58bfe48 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:36.601420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a9fdf21c-c76d-4814-85df-703ab58bfe48 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:36.635987 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a9fdf21c-c76d-4814-85df-703ab58bfe48 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.282653 Jun 02 13:54:36.637284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 52/108] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:36 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:36.812471 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-74fe1929-82bf-46de-9fae-e1fcbeb334f9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:36.813556 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-74fe1929-82bf-46de-9fae-e1fcbeb334f9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:36.820074 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-74fe1929-82bf-46de-9fae-e1fcbeb334f9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:36.820803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-74fe1929-82bf-46de-9fae-e1fcbeb334f9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:36.821731 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-74fe1929-82bf-46de-9fae-e1fcbeb334f9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:36.822345 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-74fe1929-82bf-46de-9fae-e1fcbeb334f9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:36.976439 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-74fe1929-82bf-46de-9fae-e1fcbeb334f9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:36.984761 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-74fe1929-82bf-46de-9fae-e1fcbeb334f9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:36.986804 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-74fe1929-82bf-46de-9fae-e1fcbeb334f9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:36.988204 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-74fe1929-82bf-46de-9fae-e1fcbeb334f9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.179597 Jun 02 13:54:36.988830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 57/109] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:36 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:36.990385 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ea716d48-1714-42f9-bb5e-5d58690de67b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:36.991008 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ea716d48-1714-42f9-bb5e-5d58690de67b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:36.997371 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ea716d48-1714-42f9-bb5e-5d58690de67b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:36.997899 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ea716d48-1714-42f9-bb5e-5d58690de67b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:36.999035 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ea716d48-1714-42f9-bb5e-5d58690de67b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:36.999634 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ea716d48-1714-42f9-bb5e-5d58690de67b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:37.152706 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ea716d48-1714-42f9-bb5e-5d58690de67b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:37.162944 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=100 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:37.166861 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ea716d48-1714-42f9-bb5e-5d58690de67b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.180429 Jun 02 13:54:37.169425 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 53/110] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:36 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:37.658016 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e8ce234c-e81e-4f29-9e54-d6b4f2490658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:37.658746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e8ce234c-e81e-4f29-9e54-d6b4f2490658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:37.665065 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e8ce234c-e81e-4f29-9e54-d6b4f2490658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:37.665589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e8ce234c-e81e-4f29-9e54-d6b4f2490658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:37.666428 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e8ce234c-e81e-4f29-9e54-d6b4f2490658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:37.667007 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e8ce234c-e81e-4f29-9e54-d6b4f2490658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:37.802654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e8ce234c-e81e-4f29-9e54-d6b4f2490658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:37.811722 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e8ce234c-e81e-4f29-9e54-d6b4f2490658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.158169 Jun 02 13:54:37.822604 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 58/111] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:37 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:38.010506 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1300de41-da87-4a70-a8ab-37147793575f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:38.012040 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1300de41-da87-4a70-a8ab-37147793575f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:38.019634 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1300de41-da87-4a70-a8ab-37147793575f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:38.020176 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1300de41-da87-4a70-a8ab-37147793575f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:38.021206 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1300de41-da87-4a70-a8ab-37147793575f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:38.021638 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1300de41-da87-4a70-a8ab-37147793575f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:38.166307 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1300de41-da87-4a70-a8ab-37147793575f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:38.176379 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1300de41-da87-4a70-a8ab-37147793575f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:38.178396 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1300de41-da87-4a70-a8ab-37147793575f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:38.179948 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1300de41-da87-4a70-a8ab-37147793575f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.175376 Jun 02 13:54:38.180951 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 54/112] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:38 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:38.190627 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9d8a85ed-5536-417c-8575-219af52394a7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:38.191246 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9d8a85ed-5536-417c-8575-219af52394a7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:38.198371 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d8a85ed-5536-417c-8575-219af52394a7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:38.198992 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d8a85ed-5536-417c-8575-219af52394a7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:38.200238 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d8a85ed-5536-417c-8575-219af52394a7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:38.200765 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d8a85ed-5536-417c-8575-219af52394a7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:38.392164 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9d8a85ed-5536-417c-8575-219af52394a7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:38.417198 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9d8a85ed-5536-417c-8575-219af52394a7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.233321 Jun 02 13:54:38.417821 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 59/113] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:38 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:38.830143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-40fcef84-f343-45ac-83d8-c67798e81ef5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:38.830762 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-40fcef84-f343-45ac-83d8-c67798e81ef5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:38.839239 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-40fcef84-f343-45ac-83d8-c67798e81ef5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:38.839624 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-40fcef84-f343-45ac-83d8-c67798e81ef5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:38.845121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-40fcef84-f343-45ac-83d8-c67798e81ef5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:38.845121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-40fcef84-f343-45ac-83d8-c67798e81ef5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:38.996786 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-40fcef84-f343-45ac-83d8-c67798e81ef5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:39.005544 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-40fcef84-f343-45ac-83d8-c67798e81ef5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.179850 Jun 02 13:54:39.006117 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 55/114] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:38 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:39.199885 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ec07ed75-96c3-4395-9ab0-1001e36d595b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:39.200523 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ec07ed75-96c3-4395-9ab0-1001e36d595b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:39.209230 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ec07ed75-96c3-4395-9ab0-1001e36d595b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:39.210225 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ec07ed75-96c3-4395-9ab0-1001e36d595b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:39.211508 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ec07ed75-96c3-4395-9ab0-1001e36d595b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:39.212860 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ec07ed75-96c3-4395-9ab0-1001e36d595b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:39.390083 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ec07ed75-96c3-4395-9ab0-1001e36d595b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:39.398285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ec07ed75-96c3-4395-9ab0-1001e36d595b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:39.400430 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ec07ed75-96c3-4395-9ab0-1001e36d595b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:39.401546 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ec07ed75-96c3-4395-9ab0-1001e36d595b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.206137 Jun 02 13:54:39.402311 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 60/115] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:39 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:39.434835 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-9b892432-dd28-4d72-b8d6-ff67c405311c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:39.435449 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-9b892432-dd28-4d72-b8d6-ff67c405311c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:39.441944 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9b892432-dd28-4d72-b8d6-ff67c405311c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:39.442388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9b892432-dd28-4d72-b8d6-ff67c405311c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:39.443146 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9b892432-dd28-4d72-b8d6-ff67c405311c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:39.443580 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9b892432-dd28-4d72-b8d6-ff67c405311c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:39.613363 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-9b892432-dd28-4d72-b8d6-ff67c405311c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:39.621566 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-9b892432-dd28-4d72-b8d6-ff67c405311c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.190447 Jun 02 13:54:39.622197 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 56/116] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:39 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:40.023315 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-298d3b3c-b4e9-407e-9d76-fef82df74e61 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:40.024053 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-298d3b3c-b4e9-407e-9d76-fef82df74e61 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:40.036137 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-298d3b3c-b4e9-407e-9d76-fef82df74e61 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:40.036618 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-298d3b3c-b4e9-407e-9d76-fef82df74e61 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:40.037432 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-298d3b3c-b4e9-407e-9d76-fef82df74e61 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:40.052643 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-298d3b3c-b4e9-407e-9d76-fef82df74e61 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:40.360896 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-298d3b3c-b4e9-407e-9d76-fef82df74e61 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:40.369670 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-298d3b3c-b4e9-407e-9d76-fef82df74e61 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.350538 Jun 02 13:54:40.370579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 61/117] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:40 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:40.421340 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-284e82b7-8dec-4d22-9f93-4469d0aa38f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:40.422878 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-284e82b7-8dec-4d22-9f93-4469d0aa38f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:40.431783 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-284e82b7-8dec-4d22-9f93-4469d0aa38f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:40.432560 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-284e82b7-8dec-4d22-9f93-4469d0aa38f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:40.438136 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-284e82b7-8dec-4d22-9f93-4469d0aa38f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:40.439582 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-284e82b7-8dec-4d22-9f93-4469d0aa38f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:40.647920 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c98e4871-eec4-4ec8-9705-d31a949f3e64 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:40.648575 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c98e4871-eec4-4ec8-9705-d31a949f3e64 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:40.660124 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c98e4871-eec4-4ec8-9705-d31a949f3e64 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:40.661648 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c98e4871-eec4-4ec8-9705-d31a949f3e64 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:40.663046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c98e4871-eec4-4ec8-9705-d31a949f3e64 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:40.663486 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c98e4871-eec4-4ec8-9705-d31a949f3e64 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:40.829885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-284e82b7-8dec-4d22-9f93-4469d0aa38f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:40.839612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-284e82b7-8dec-4d22-9f93-4469d0aa38f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:40.855738 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-284e82b7-8dec-4d22-9f93-4469d0aa38f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:40.858531 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-284e82b7-8dec-4d22-9f93-4469d0aa38f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.442392 Jun 02 13:54:40.871597 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 57/118] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:40 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:40.959599 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c98e4871-eec4-4ec8-9705-d31a949f3e64 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:40.973796 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c98e4871-eec4-4ec8-9705-d31a949f3e64 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.329180 Jun 02 13:54:40.975451 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 62/119] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:40 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:41.388655 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2d2ac8b0-64c0-4c2c-a321-0da13e4a5e51 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:41.389280 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-2d2ac8b0-64c0-4c2c-a321-0da13e4a5e51 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:41.396941 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2d2ac8b0-64c0-4c2c-a321-0da13e4a5e51 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:41.397390 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2d2ac8b0-64c0-4c2c-a321-0da13e4a5e51 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:41.398313 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2d2ac8b0-64c0-4c2c-a321-0da13e4a5e51 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:41.398802 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2d2ac8b0-64c0-4c2c-a321-0da13e4a5e51 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:41.627558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2d2ac8b0-64c0-4c2c-a321-0da13e4a5e51 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:41.637747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2d2ac8b0-64c0-4c2c-a321-0da13e4a5e51 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.254208 Jun 02 13:54:41.638522 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 58/120] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:41 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:41.684519 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-a90c3a41-3f85-4e77-a817-f8f285842a24 req-66942313-fd9b-4416-861e-daa0fa1c49f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5490e17-83da-4dfb-a31f-60d619f614be", "name": "network-vif-plugged", "status": "completed", "tag": "f147c0c8-1142-49a5-ab6f-3a7caee335c3"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:41.696656 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-a90c3a41-3f85-4e77-a817-f8f285842a24 req-66942313-fd9b-4416-861e-daa0fa1c49f6 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:41.702982 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-a90c3a41-3f85-4e77-a817-f8f285842a24 req-66942313-fd9b-4416-861e-daa0fa1c49f6 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:41.709899 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-a90c3a41-3f85-4e77-a817-f8f285842a24 req-66942313-fd9b-4416-861e-daa0fa1c49f6 service nova] Creating event network-vif-plugged:f147c0c8-1142-49a5-ab6f-3a7caee335c3 for instance b5490e17-83da-4dfb-a31f-60d619f614be on hv-cinder-82651 Jun 02 13:54:41.715013 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-a90c3a41-3f85-4e77-a817-f8f285842a24 req-66942313-fd9b-4416-861e-daa0fa1c49f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094612 Jun 02 13:54:41.715697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 63/121] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:54:41.877273 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a6c91b66-a4a6-4489-ab60-ab5e8d807c54 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:41.877882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a6c91b66-a4a6-4489-ab60-ab5e8d807c54 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:41.883799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a6c91b66-a4a6-4489-ab60-ab5e8d807c54 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:41.884284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a6c91b66-a4a6-4489-ab60-ab5e8d807c54 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:41.885080 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a6c91b66-a4a6-4489-ab60-ab5e8d807c54 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:41.885508 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a6c91b66-a4a6-4489-ab60-ab5e8d807c54 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:42.001819 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5290f478-7404-436b-a07d-c597420f72b4 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:42.002630 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-5290f478-7404-436b-a07d-c597420f72b4 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:42.011795 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5290f478-7404-436b-a07d-c597420f72b4 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:42.012321 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5290f478-7404-436b-a07d-c597420f72b4 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:42.013231 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5290f478-7404-436b-a07d-c597420f72b4 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:42.013755 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5290f478-7404-436b-a07d-c597420f72b4 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:42.028850 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a6c91b66-a4a6-4489-ab60-ab5e8d807c54 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:42.041774 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a6c91b66-a4a6-4489-ab60-ab5e8d807c54 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:42.043356 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a6c91b66-a4a6-4489-ab60-ab5e8d807c54 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:42.044975 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a6c91b66-a4a6-4489-ab60-ab5e8d807c54 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.172206 Jun 02 13:54:42.045721 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 59/122] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:41 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:42.155957 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5290f478-7404-436b-a07d-c597420f72b4 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:42.164076 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5290f478-7404-436b-a07d-c597420f72b4 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.168631 Jun 02 13:54:42.164738 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 64/123] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:41 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:42.655679 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b7e5ffce-9ce1-499e-8912-3305098943b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:42.656952 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b7e5ffce-9ce1-499e-8912-3305098943b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:42.674006 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7e5ffce-9ce1-499e-8912-3305098943b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:42.674456 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7e5ffce-9ce1-499e-8912-3305098943b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:42.675928 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7e5ffce-9ce1-499e-8912-3305098943b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:42.676359 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7e5ffce-9ce1-499e-8912-3305098943b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:42.884738 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b7e5ffce-9ce1-499e-8912-3305098943b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:42.892939 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b7e5ffce-9ce1-499e-8912-3305098943b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.241606 Jun 02 13:54:42.893512 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 60/124] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:42 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:43.065076 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2236589e-6853-4e4f-87df-cfc622bd7941 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:43.066171 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2236589e-6853-4e4f-87df-cfc622bd7941 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:43.072221 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2236589e-6853-4e4f-87df-cfc622bd7941 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:43.072780 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2236589e-6853-4e4f-87df-cfc622bd7941 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:43.073651 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2236589e-6853-4e4f-87df-cfc622bd7941 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:43.074215 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2236589e-6853-4e4f-87df-cfc622bd7941 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:43.184932 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1e3a55b0-a62b-417c-a0ea-afadc0d4510d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:43.186543 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1e3a55b0-a62b-417c-a0ea-afadc0d4510d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:43.196834 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e3a55b0-a62b-417c-a0ea-afadc0d4510d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:43.205187 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e3a55b0-a62b-417c-a0ea-afadc0d4510d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:43.205187 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e3a55b0-a62b-417c-a0ea-afadc0d4510d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:43.205187 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e3a55b0-a62b-417c-a0ea-afadc0d4510d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:43.276704 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2236589e-6853-4e4f-87df-cfc622bd7941 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:43.284966 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2236589e-6853-4e4f-87df-cfc622bd7941 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:43.286526 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2236589e-6853-4e4f-87df-cfc622bd7941 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:43.287642 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2236589e-6853-4e4f-87df-cfc622bd7941 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.227380 Jun 02 13:54:43.288194 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 65/125] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:43 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:43.377662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1e3a55b0-a62b-417c-a0ea-afadc0d4510d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:43.386808 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1e3a55b0-a62b-417c-a0ea-afadc0d4510d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.208635 Jun 02 13:54:43.387874 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 61/126] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:43 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:43.728815 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-22727a9d-9d24-4bf0-b839-f2734d48ac99 req-831a0546-0834-4126-b87d-e0d72fcd5897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478fcfd0-657e-41c0-b9f2-38f449129a3b", "name": "network-vif-plugged", "status": "completed", "tag": "96fe44df-3a9f-4a2e-937a-7e7f60525297"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:43.737543 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-22727a9d-9d24-4bf0-b839-f2734d48ac99 req-831a0546-0834-4126-b87d-e0d72fcd5897 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:43.738088 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-22727a9d-9d24-4bf0-b839-f2734d48ac99 req-831a0546-0834-4126-b87d-e0d72fcd5897 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:43.757330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-22727a9d-9d24-4bf0-b839-f2734d48ac99 req-831a0546-0834-4126-b87d-e0d72fcd5897 service nova] Creating event network-vif-plugged:96fe44df-3a9f-4a2e-937a-7e7f60525297 for instance 478fcfd0-657e-41c0-b9f2-38f449129a3b on hv-cinder-82651 Jun 02 13:54:43.762162 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-22727a9d-9d24-4bf0-b839-f2734d48ac99 req-831a0546-0834-4126-b87d-e0d72fcd5897 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037007 Jun 02 13:54:43.762759 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 66/127] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:54:43.910679 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-316a6c7c-17c8-41e3-9fd3-f10f1b9f4837 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:43.911299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-316a6c7c-17c8-41e3-9fd3-f10f1b9f4837 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:43.917964 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-316a6c7c-17c8-41e3-9fd3-f10f1b9f4837 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:43.918420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-316a6c7c-17c8-41e3-9fd3-f10f1b9f4837 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:43.919174 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-316a6c7c-17c8-41e3-9fd3-f10f1b9f4837 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:43.919990 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-316a6c7c-17c8-41e3-9fd3-f10f1b9f4837 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:44.083191 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-316a6c7c-17c8-41e3-9fd3-f10f1b9f4837 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:44.091136 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-316a6c7c-17c8-41e3-9fd3-f10f1b9f4837 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.184241 Jun 02 13:54:44.092104 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 62/128] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:43 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:44.308020 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0ae61091-ae59-4758-a6ba-c8e7641e6676 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:44.308870 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0ae61091-ae59-4758-a6ba-c8e7641e6676 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:44.317129 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ae61091-ae59-4758-a6ba-c8e7641e6676 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:44.317567 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ae61091-ae59-4758-a6ba-c8e7641e6676 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:44.318553 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ae61091-ae59-4758-a6ba-c8e7641e6676 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:44.319012 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ae61091-ae59-4758-a6ba-c8e7641e6676 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:44.405111 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e261d1c3-ee43-440e-970e-180ed584cf86 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:44.405732 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e261d1c3-ee43-440e-970e-180ed584cf86 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:44.426654 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e261d1c3-ee43-440e-970e-180ed584cf86 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:44.426654 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e261d1c3-ee43-440e-970e-180ed584cf86 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:44.426654 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e261d1c3-ee43-440e-970e-180ed584cf86 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:44.426654 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e261d1c3-ee43-440e-970e-180ed584cf86 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:44.462869 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0ae61091-ae59-4758-a6ba-c8e7641e6676 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:44.472578 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0ae61091-ae59-4758-a6ba-c8e7641e6676 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:44.474346 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0ae61091-ae59-4758-a6ba-c8e7641e6676 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:44.475554 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0ae61091-ae59-4758-a6ba-c8e7641e6676 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.172807 Jun 02 13:54:44.476609 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 67/129] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:44 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:44.626703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e261d1c3-ee43-440e-970e-180ed584cf86 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:44.637084 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e261d1c3-ee43-440e-970e-180ed584cf86 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.235854 Jun 02 13:54:44.637782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 63/130] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:44 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:45.108811 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8228c839-fb21-43b2-ac12-d9529d9f09c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:45.110360 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8228c839-fb21-43b2-ac12-d9529d9f09c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:45.123722 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8228c839-fb21-43b2-ac12-d9529d9f09c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:45.123722 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8228c839-fb21-43b2-ac12-d9529d9f09c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:45.123722 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8228c839-fb21-43b2-ac12-d9529d9f09c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:45.123722 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8228c839-fb21-43b2-ac12-d9529d9f09c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:45.270552 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8228c839-fb21-43b2-ac12-d9529d9f09c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:45.280305 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8228c839-fb21-43b2-ac12-d9529d9f09c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.175889 Jun 02 13:54:45.289842 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 68/131] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:45 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:45.494676 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4097a217-6bb4-4b69-9000-911d948f1179 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:45.496480 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4097a217-6bb4-4b69-9000-911d948f1179 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:45.504783 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4097a217-6bb4-4b69-9000-911d948f1179 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:45.508172 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4097a217-6bb4-4b69-9000-911d948f1179 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:45.508172 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4097a217-6bb4-4b69-9000-911d948f1179 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:45.508172 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4097a217-6bb4-4b69-9000-911d948f1179 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:45.656874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-1d3d7655-82db-44a3-82b5-590f5bce1456 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:45.658304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-1d3d7655-82db-44a3-82b5-590f5bce1456 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:45.683496 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1d3d7655-82db-44a3-82b5-590f5bce1456 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:45.684175 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1d3d7655-82db-44a3-82b5-590f5bce1456 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:45.685821 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1d3d7655-82db-44a3-82b5-590f5bce1456 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:45.686618 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1d3d7655-82db-44a3-82b5-590f5bce1456 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:45.912887 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4097a217-6bb4-4b69-9000-911d948f1179 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:45.919864 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4097a217-6bb4-4b69-9000-911d948f1179 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:45.923192 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4097a217-6bb4-4b69-9000-911d948f1179 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:45.924486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4097a217-6bb4-4b69-9000-911d948f1179 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.434383 Jun 02 13:54:45.925423 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 64/132] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:45 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:45.940477 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1d3d7655-82db-44a3-82b5-590f5bce1456 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:45.947913 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-1d3d7655-82db-44a3-82b5-590f5bce1456 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.297281 Jun 02 13:54:45.948532 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 69/133] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:45 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:46.297919 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3dc16443-1c02-4b54-aa89-cbf98bc39525 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:46.298523 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3dc16443-1c02-4b54-aa89-cbf98bc39525 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:46.304578 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3dc16443-1c02-4b54-aa89-cbf98bc39525 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:46.304960 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3dc16443-1c02-4b54-aa89-cbf98bc39525 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:46.305703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3dc16443-1c02-4b54-aa89-cbf98bc39525 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:46.306128 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3dc16443-1c02-4b54-aa89-cbf98bc39525 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:46.454395 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3dc16443-1c02-4b54-aa89-cbf98bc39525 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:46.467297 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3dc16443-1c02-4b54-aa89-cbf98bc39525 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.173746 Jun 02 13:54:46.467972 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 65/134] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:46 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:46.942698 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-00511fe1-a180-49a3-9df7-e5f8105cf05c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:46.943307 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-00511fe1-a180-49a3-9df7-e5f8105cf05c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:46.949660 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-00511fe1-a180-49a3-9df7-e5f8105cf05c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:46.950100 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-00511fe1-a180-49a3-9df7-e5f8105cf05c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:46.959541 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-00511fe1-a180-49a3-9df7-e5f8105cf05c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:46.959541 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-00511fe1-a180-49a3-9df7-e5f8105cf05c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:46.965687 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-554dd408-da26-4020-af0c-5d918f73f150 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:46.967074 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-554dd408-da26-4020-af0c-5d918f73f150 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:46.973949 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-554dd408-da26-4020-af0c-5d918f73f150 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:46.974391 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-554dd408-da26-4020-af0c-5d918f73f150 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:46.975324 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-554dd408-da26-4020-af0c-5d918f73f150 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:46.975759 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-554dd408-da26-4020-af0c-5d918f73f150 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:47.222863 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-554dd408-da26-4020-af0c-5d918f73f150 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:47.242104 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-554dd408-da26-4020-af0c-5d918f73f150 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.279213 Jun 02 13:54:47.245882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 66/135] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:46 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:47.263737 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-00511fe1-a180-49a3-9df7-e5f8105cf05c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:47.285509 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-00511fe1-a180-49a3-9df7-e5f8105cf05c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:47.290715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-00511fe1-a180-49a3-9df7-e5f8105cf05c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:47.295910 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-00511fe1-a180-49a3-9df7-e5f8105cf05c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.357187 Jun 02 13:54:47.298996 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 70/136] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:46 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:47.484230 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ff050ae2-ab87-43bf-96ac-90b8dbb52d0e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:47.484944 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ff050ae2-ab87-43bf-96ac-90b8dbb52d0e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:47.491903 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=83 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:47.495384 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ff050ae2-ab87-43bf-96ac-90b8dbb52d0e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:47.495871 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ff050ae2-ab87-43bf-96ac-90b8dbb52d0e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:47.496664 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ff050ae2-ab87-43bf-96ac-90b8dbb52d0e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:47.497116 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ff050ae2-ab87-43bf-96ac-90b8dbb52d0e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:47.744054 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ff050ae2-ab87-43bf-96ac-90b8dbb52d0e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:47.758063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ff050ae2-ab87-43bf-96ac-90b8dbb52d0e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.272867 Jun 02 13:54:47.758718 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 67/137] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:47 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:47.869411 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-5abbeb77-5748-4078-9905-82749d97db5b req-f53ffec0-98f5-4fbc-9d52-0b2dd71d588e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d462ae-af14-4d5d-aab2-f45954429480", "name": "network-vif-plugged", "status": "completed", "tag": "9494633c-b230-4406-ab57-d1f3d39fc4d6"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:47.878452 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-5abbeb77-5748-4078-9905-82749d97db5b req-f53ffec0-98f5-4fbc-9d52-0b2dd71d588e service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:47.878922 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-5abbeb77-5748-4078-9905-82749d97db5b req-f53ffec0-98f5-4fbc-9d52-0b2dd71d588e service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:47.891310 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-5abbeb77-5748-4078-9905-82749d97db5b req-f53ffec0-98f5-4fbc-9d52-0b2dd71d588e service nova] Creating event network-vif-plugged:9494633c-b230-4406-ab57-d1f3d39fc4d6 for instance 83d462ae-af14-4d5d-aab2-f45954429480 on hv-cinder-82651 Jun 02 13:54:47.899206 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-5abbeb77-5748-4078-9905-82749d97db5b req-f53ffec0-98f5-4fbc-9d52-0b2dd71d588e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034786 Jun 02 13:54:47.899903 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 71/138] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:54:48.279724 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f8b163cd-77b2-432d-9279-e5ab6cf2b15d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:48.283712 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f8b163cd-77b2-432d-9279-e5ab6cf2b15d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:48.315473 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f8b163cd-77b2-432d-9279-e5ab6cf2b15d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:48.316540 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f8b163cd-77b2-432d-9279-e5ab6cf2b15d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:48.319503 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f951a0d0-f3e5-4e5c-89c4-c69544758851 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:48.320106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f8b163cd-77b2-432d-9279-e5ab6cf2b15d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:48.320453 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f951a0d0-f3e5-4e5c-89c4-c69544758851 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:48.320857 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f8b163cd-77b2-432d-9279-e5ab6cf2b15d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:48.329985 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f951a0d0-f3e5-4e5c-89c4-c69544758851 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:48.330451 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f951a0d0-f3e5-4e5c-89c4-c69544758851 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:48.331231 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f951a0d0-f3e5-4e5c-89c4-c69544758851 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:48.331666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f951a0d0-f3e5-4e5c-89c4-c69544758851 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:48.563982 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f951a0d0-f3e5-4e5c-89c4-c69544758851 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:48.574175 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f951a0d0-f3e5-4e5c-89c4-c69544758851 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:48.576515 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f951a0d0-f3e5-4e5c-89c4-c69544758851 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:48.578289 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f951a0d0-f3e5-4e5c-89c4-c69544758851 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.264130 Jun 02 13:54:48.582790 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f8b163cd-77b2-432d-9279-e5ab6cf2b15d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:48.593964 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 72/139] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:48 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:48.594149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f8b163cd-77b2-432d-9279-e5ab6cf2b15d tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.330407 Jun 02 13:54:48.594149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 68/140] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:48 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:48.774447 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-95e80afb-a243-49a5-9be0-d2cbf536efbc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:48.775212 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-95e80afb-a243-49a5-9be0-d2cbf536efbc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:48.781580 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-95e80afb-a243-49a5-9be0-d2cbf536efbc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:48.782029 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-95e80afb-a243-49a5-9be0-d2cbf536efbc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:48.782798 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-95e80afb-a243-49a5-9be0-d2cbf536efbc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:48.783233 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-95e80afb-a243-49a5-9be0-d2cbf536efbc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:49.117070 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-95e80afb-a243-49a5-9be0-d2cbf536efbc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:49.126009 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-95e80afb-a243-49a5-9be0-d2cbf536efbc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.355256 Jun 02 13:54:49.128470 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 73/141] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:48 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:49.613858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-9706cfef-da08-4ff3-9aa7-a80fc686ae16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:49.614476 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-9706cfef-da08-4ff3-9aa7-a80fc686ae16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:49.614968 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c4b62612-ce11-4b0b-b020-04ed666f7dd7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:49.615616 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c4b62612-ce11-4b0b-b020-04ed666f7dd7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:49.623370 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c4b62612-ce11-4b0b-b020-04ed666f7dd7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:49.623816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c4b62612-ce11-4b0b-b020-04ed666f7dd7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:49.625147 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c4b62612-ce11-4b0b-b020-04ed666f7dd7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:49.625587 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c4b62612-ce11-4b0b-b020-04ed666f7dd7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:49.627926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9706cfef-da08-4ff3-9aa7-a80fc686ae16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:49.628371 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9706cfef-da08-4ff3-9aa7-a80fc686ae16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:49.629353 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9706cfef-da08-4ff3-9aa7-a80fc686ae16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:49.629946 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9706cfef-da08-4ff3-9aa7-a80fc686ae16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:49.923376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-9706cfef-da08-4ff3-9aa7-a80fc686ae16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:49.938932 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-9706cfef-da08-4ff3-9aa7-a80fc686ae16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:49.948360 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-9706cfef-da08-4ff3-9aa7-a80fc686ae16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:49.952819 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c4b62612-ce11-4b0b-b020-04ed666f7dd7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:49.955922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-9706cfef-da08-4ff3-9aa7-a80fc686ae16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.346505 Jun 02 13:54:49.958559 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 69/142] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:49 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:49.959707 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:49.964394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c4b62612-ce11-4b0b-b020-04ed666f7dd7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1314 microversion: 2.1 time: 0.354645 Jun 02 13:54:49.964994 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 74/143] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:49 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:49.971259 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-70d107ec-953c-4ea5-9be1-4bd78859c058 req-38e6db4f-2380-443a-b01a-201df5f74fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4ee4c28-6107-46d9-8461-8fcbd382c245", "name": "network-vif-plugged", "status": "completed", "tag": "5133c089-5826-4ecd-ac3b-a6905f94a47a"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:49.981887 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-70d107ec-953c-4ea5-9be1-4bd78859c058 req-38e6db4f-2380-443a-b01a-201df5f74fba service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:49.982658 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-70d107ec-953c-4ea5-9be1-4bd78859c058 req-38e6db4f-2380-443a-b01a-201df5f74fba service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:49.997107 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-70d107ec-953c-4ea5-9be1-4bd78859c058 req-38e6db4f-2380-443a-b01a-201df5f74fba service nova] Creating event network-vif-plugged:5133c089-5826-4ecd-ac3b-a6905f94a47a for instance f4ee4c28-6107-46d9-8461-8fcbd382c245 on hv-cinder-82651 Jun 02 13:54:50.006153 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-70d107ec-953c-4ea5-9be1-4bd78859c058 req-38e6db4f-2380-443a-b01a-201df5f74fba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045838 Jun 02 13:54:50.007531 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 70/144] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:54:50.144133 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-051a40c5-a98c-4084-b7da-aeabde035212 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:50.145113 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-051a40c5-a98c-4084-b7da-aeabde035212 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:50.151318 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-051a40c5-a98c-4084-b7da-aeabde035212 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:50.151878 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-051a40c5-a98c-4084-b7da-aeabde035212 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:50.152791 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-051a40c5-a98c-4084-b7da-aeabde035212 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:50.153316 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-051a40c5-a98c-4084-b7da-aeabde035212 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:50.339190 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-051a40c5-a98c-4084-b7da-aeabde035212 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:50.352995 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-051a40c5-a98c-4084-b7da-aeabde035212 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.213121 Jun 02 13:54:50.368371 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 75/145] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:50 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:50.978877 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f05853d3-eefc-4e48-9a58-fe9d4e6be646 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:50.979779 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f05853d3-eefc-4e48-9a58-fe9d4e6be646 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:50.982428 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-157109fe-783e-405c-ba12-385aba2817c6 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:50.983035 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-157109fe-783e-405c-ba12-385aba2817c6 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:50.986880 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f05853d3-eefc-4e48-9a58-fe9d4e6be646 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:50.987434 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f05853d3-eefc-4e48-9a58-fe9d4e6be646 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:50.988828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f05853d3-eefc-4e48-9a58-fe9d4e6be646 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:50.990972 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-157109fe-783e-405c-ba12-385aba2817c6 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:50.991201 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f05853d3-eefc-4e48-9a58-fe9d4e6be646 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:50.991755 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-157109fe-783e-405c-ba12-385aba2817c6 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:50.992551 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-157109fe-783e-405c-ba12-385aba2817c6 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:50.993131 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-157109fe-783e-405c-ba12-385aba2817c6 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:50.996204 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=100 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:51.347014 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-157109fe-783e-405c-ba12-385aba2817c6 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:51.355369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-157109fe-783e-405c-ba12-385aba2817c6 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1502 microversion: 2.1 time: 0.376788 Jun 02 13:54:51.355848 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 76/146] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:50 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1502 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:51.372720 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e4c1a069-3233-4932-bc88-a0fb659d2d82 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:51.375662 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e4c1a069-3233-4932-bc88-a0fb659d2d82 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:51.383908 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e4c1a069-3233-4932-bc88-a0fb659d2d82 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:51.384726 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e4c1a069-3233-4932-bc88-a0fb659d2d82 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:51.385802 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e4c1a069-3233-4932-bc88-a0fb659d2d82 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:51.386955 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e4c1a069-3233-4932-bc88-a0fb659d2d82 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:51.391818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f05853d3-eefc-4e48-9a58-fe9d4e6be646 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:51.406978 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f05853d3-eefc-4e48-9a58-fe9d4e6be646 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:51.411701 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f05853d3-eefc-4e48-9a58-fe9d4e6be646 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:51.414392 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f05853d3-eefc-4e48-9a58-fe9d4e6be646 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1406 microversion: 2.20 time: 0.442270 Jun 02 13:54:51.415407 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 71/147] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:50 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1406 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:54:51.600997 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e4c1a069-3233-4932-bc88-a0fb659d2d82 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:51.608603 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e4c1a069-3233-4932-bc88-a0fb659d2d82 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.241762 Jun 02 13:54:51.609443 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 77/148] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:51 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:52.433524 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-370e5e9a-667b-49d5-b640-5e5af86d6c2f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:52.434133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-370e5e9a-667b-49d5-b640-5e5af86d6c2f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:52.441738 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-370e5e9a-667b-49d5-b640-5e5af86d6c2f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:52.442393 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-370e5e9a-667b-49d5-b640-5e5af86d6c2f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:52.443357 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-370e5e9a-667b-49d5-b640-5e5af86d6c2f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:52.443778 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-370e5e9a-667b-49d5-b640-5e5af86d6c2f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:52.615561 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-370e5e9a-667b-49d5-b640-5e5af86d6c2f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:52.624807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-370e5e9a-667b-49d5-b640-5e5af86d6c2f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:52.627270 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-89d05378-f4c5-4e78-a700-a71415df65db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:52.627780 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-370e5e9a-667b-49d5-b640-5e5af86d6c2f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:52.628097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-89d05378-f4c5-4e78-a700-a71415df65db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:52.629154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-370e5e9a-667b-49d5-b640-5e5af86d6c2f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1598 microversion: 2.20 time: 0.199198 Jun 02 13:54:52.630074 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 72/149] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:54:52 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1598 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:54:52.634701 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-89d05378-f4c5-4e78-a700-a71415df65db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:52.635232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-89d05378-f4c5-4e78-a700-a71415df65db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:52.642351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-89d05378-f4c5-4e78-a700-a71415df65db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:52.642351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-89d05378-f4c5-4e78-a700-a71415df65db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:52.648639 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5f5875a0-04bd-4f57-80c2-5cea0e1714bb tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:52.649205 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5f5875a0-04bd-4f57-80c2-5cea0e1714bb tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:52.655742 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f5875a0-04bd-4f57-80c2-5cea0e1714bb tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:52.656576 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f5875a0-04bd-4f57-80c2-5cea0e1714bb tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:52.657743 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f5875a0-04bd-4f57-80c2-5cea0e1714bb tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:52.658490 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f5875a0-04bd-4f57-80c2-5cea0e1714bb tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:52.807932 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5f5875a0-04bd-4f57-80c2-5cea0e1714bb tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.163245 Jun 02 13:54:52.808612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 73/150] 10.222.0.33 () {60 vars in 1315 bytes} [Thu Jun 2 13:54:52 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:54:52.878374 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-89d05378-f4c5-4e78-a700-a71415df65db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:52.886911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-89d05378-f4c5-4e78-a700-a71415df65db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.264662 Jun 02 13:54:52.887494 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 78/151] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:52 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:53.903569 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c0e7f6a2-ea06-4040-bd27-125c5289268d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:53.904269 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c0e7f6a2-ea06-4040-bd27-125c5289268d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:53.911160 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c0e7f6a2-ea06-4040-bd27-125c5289268d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:53.911821 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c0e7f6a2-ea06-4040-bd27-125c5289268d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:53.913605 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c0e7f6a2-ea06-4040-bd27-125c5289268d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:53.914123 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c0e7f6a2-ea06-4040-bd27-125c5289268d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:54.114645 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c0e7f6a2-ea06-4040-bd27-125c5289268d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:54.122859 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c0e7f6a2-ea06-4040-bd27-125c5289268d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.223564 Jun 02 13:54:54.123430 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 74/152] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:53 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:54.350845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-ce71a3eb-b6be-4919-a252-70cf5df5090d req-e8502e8e-3f2f-4fd3-ac70-c74e12ef136e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d462ae-af14-4d5d-aab2-f45954429480", "tag": "9494633c-b230-4406-ab57-d1f3d39fc4d6"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:54.360031 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-ce71a3eb-b6be-4919-a252-70cf5df5090d req-e8502e8e-3f2f-4fd3-ac70-c74e12ef136e service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:54.360503 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-ce71a3eb-b6be-4919-a252-70cf5df5090d req-e8502e8e-3f2f-4fd3-ac70-c74e12ef136e service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:54.373476 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-ce71a3eb-b6be-4919-a252-70cf5df5090d req-e8502e8e-3f2f-4fd3-ac70-c74e12ef136e service nova] Creating event network-changed:9494633c-b230-4406-ab57-d1f3d39fc4d6 for instance 83d462ae-af14-4d5d-aab2-f45954429480 on hv-cinder-82651 Jun 02 13:54:54.379417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-ce71a3eb-b6be-4919-a252-70cf5df5090d req-e8502e8e-3f2f-4fd3-ac70-c74e12ef136e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032015 Jun 02 13:54:54.383083 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 79/153] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:54:54.404991 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-163996181", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:54.459485 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.network.neutron [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] validate_networks() for None {{(pid=118315) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:54:54.803519 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Flavor limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:54:54.803959 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Image limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:54:54.804504 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Flavor pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:54:54.804904 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Image pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:54:54.805293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:54:54.814904 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:54.815351 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:54.816154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:54.816620 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:54.838197 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Getting quotas for project 0d6b4382cb104dde8ef340d6cf4f3037. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:54:54.842794 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Getting quotas for user 65aafb8e5b564f6894cb49f2de27d4d0 and project 0d6b4382cb104dde8ef340d6cf4f3037. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:54:54.855199 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Going to run 1 instances... {{(pid=118315) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:54:54.857640 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118315) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:54:55.029719 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3cb797ff-5469-4239-a911-4eec5e887198 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628571 Jun 02 13:54:55.031399 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 75/154] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 13:54:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:54:55.042940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-989065d4-51d4-4aff-b876-8d9e3d406467 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:55.044783 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-989065d4-51d4-4aff-b876-8d9e3d406467 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:55.111080 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-989065d4-51d4-4aff-b876-8d9e3d406467 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:55.118852 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-989065d4-51d4-4aff-b876-8d9e3d406467 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1214 microversion: 2.1 time: 0.081217 Jun 02 13:54:55.119603 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 80/155] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:55 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:55.142407 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-522dda14-6078-415e-9420-11a2b6dddf72 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:55.148339 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-522dda14-6078-415e-9420-11a2b6dddf72 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:55.155701 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-522dda14-6078-415e-9420-11a2b6dddf72 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:55.156708 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-522dda14-6078-415e-9420-11a2b6dddf72 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:55.157598 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-522dda14-6078-415e-9420-11a2b6dddf72 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:55.158024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-522dda14-6078-415e-9420-11a2b6dddf72 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:55.300262 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-522dda14-6078-415e-9420-11a2b6dddf72 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:55.308539 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-522dda14-6078-415e-9420-11a2b6dddf72 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.171207 Jun 02 13:54:55.309147 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 76/156] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:55 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:56.136852 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9f774fce-f1ce-4fa7-ab89-8cff67d3fd2b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:56.137466 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9f774fce-f1ce-4fa7-ab89-8cff67d3fd2b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:56.192157 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9f774fce-f1ce-4fa7-ab89-8cff67d3fd2b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:56.199282 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9f774fce-f1ce-4fa7-ab89-8cff67d3fd2b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1214 microversion: 2.1 time: 0.066496 Jun 02 13:54:56.200084 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 81/157] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:56 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:56.326672 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f2e0766b-8bff-43db-9563-f60c8099dc99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:56.327400 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f2e0766b-8bff-43db-9563-f60c8099dc99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:56.333698 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f2e0766b-8bff-43db-9563-f60c8099dc99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:56.334241 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f2e0766b-8bff-43db-9563-f60c8099dc99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:56.335012 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f2e0766b-8bff-43db-9563-f60c8099dc99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:56.335449 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f2e0766b-8bff-43db-9563-f60c8099dc99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:56.462553 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f2e0766b-8bff-43db-9563-f60c8099dc99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:56.470770 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f2e0766b-8bff-43db-9563-f60c8099dc99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.148325 Jun 02 13:54:56.471345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 77/158] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:56 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:57.216727 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-21196be2-0b15-4d50-b21f-7758c35d7f8f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:57.217422 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-21196be2-0b15-4d50-b21f-7758c35d7f8f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:57.219594 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=86 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:57.224681 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21196be2-0b15-4d50-b21f-7758c35d7f8f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:57.225130 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21196be2-0b15-4d50-b21f-7758c35d7f8f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:57.225890 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21196be2-0b15-4d50-b21f-7758c35d7f8f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:57.226358 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21196be2-0b15-4d50-b21f-7758c35d7f8f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:57.291807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-21196be2-0b15-4d50-b21f-7758c35d7f8f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:57.300016 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-21196be2-0b15-4d50-b21f-7758c35d7f8f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1218 microversion: 2.1 time: 0.087289 Jun 02 13:54:57.300619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 82/159] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:57 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:57.488551 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e4b4b328-2f51-4009-b6ee-97e92c14bee5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:57.489181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e4b4b328-2f51-4009-b6ee-97e92c14bee5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:57.495872 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e4b4b328-2f51-4009-b6ee-97e92c14bee5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:57.496436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e4b4b328-2f51-4009-b6ee-97e92c14bee5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:57.497319 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e4b4b328-2f51-4009-b6ee-97e92c14bee5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:57.497802 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e4b4b328-2f51-4009-b6ee-97e92c14bee5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:57.787232 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e4b4b328-2f51-4009-b6ee-97e92c14bee5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:57.794806 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e4b4b328-2f51-4009-b6ee-97e92c14bee5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1322 microversion: 2.1 time: 0.311334 Jun 02 13:54:57.795355 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 78/160] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:57 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:58.318110 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-91bcc1e8-fffe-4bbd-9cea-2baae7df7a86 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:58.319485 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-91bcc1e8-fffe-4bbd-9cea-2baae7df7a86 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:58.326026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-91bcc1e8-fffe-4bbd-9cea-2baae7df7a86 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:58.326463 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-91bcc1e8-fffe-4bbd-9cea-2baae7df7a86 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:58.327212 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-91bcc1e8-fffe-4bbd-9cea-2baae7df7a86 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:58.327985 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-91bcc1e8-fffe-4bbd-9cea-2baae7df7a86 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:58.389180 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-91bcc1e8-fffe-4bbd-9cea-2baae7df7a86 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:58.397358 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-91bcc1e8-fffe-4bbd-9cea-2baae7df7a86 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1210 microversion: 2.1 time: 0.084293 Jun 02 13:54:58.397927 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 83/161] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:58 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:54:58.799207 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-cf3fc922-e63f-46d4-9954-f95d72f988c1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3215df2c-483a-459b-b55c-c2fa9a9c651a"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:58.800357 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-cf3fc922-e63f-46d4-9954-f95d72f988c1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:58.808116 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cf3fc922-e63f-46d4-9954-f95d72f988c1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:58.808850 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cf3fc922-e63f-46d4-9954-f95d72f988c1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:58.809733 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cf3fc922-e63f-46d4-9954-f95d72f988c1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:58.814476 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cf3fc922-e63f-46d4-9954-f95d72f988c1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:58.814593 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c0264354-bae1-4487-a2fa-53496eafe1f3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:54:58.814593 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c0264354-bae1-4487-a2fa-53496eafe1f3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:58.819029 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c0264354-bae1-4487-a2fa-53496eafe1f3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:58.819483 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c0264354-bae1-4487-a2fa-53496eafe1f3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:58.820272 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c0264354-bae1-4487-a2fa-53496eafe1f3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:58.820733 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c0264354-bae1-4487-a2fa-53496eafe1f3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:58.956504 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c0264354-bae1-4487-a2fa-53496eafe1f3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:54:58.964149 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c0264354-bae1-4487-a2fa-53496eafe1f3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1515 microversion: 2.1 time: 0.156292 Jun 02 13:54:58.964859 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 84/162] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:54:58 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:54:58.982242 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-999d6f41-6ee0-41b8-ae85-d100986d4cd0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:54:58.983173 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-999d6f41-6ee0-41b8-ae85-d100986d4cd0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:54:58.989909 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-999d6f41-6ee0-41b8-ae85-d100986d4cd0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:58.990353 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-999d6f41-6ee0-41b8-ae85-d100986d4cd0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:58.991108 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-999d6f41-6ee0-41b8-ae85-d100986d4cd0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:54:58.991527 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-999d6f41-6ee0-41b8-ae85-d100986d4cd0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:54:59.052502 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-999d6f41-6ee0-41b8-ae85-d100986d4cd0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lazy-loading 'flavor' on Instance uuid f4ee4c28-6107-46d9-8461-8fcbd382c245 {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:55:00.023472 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-999d6f41-6ee0-41b8-ae85-d100986d4cd0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "POST /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245/action" status: 200 len: 32 microversion: 2.1 time: 1.045161 Jun 02 13:55:00.024939 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 85/163] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 2 13:54:58 2022] POST /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245/action => generated 32 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 02 13:55:00.032865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-03ea6b46-06e3-4192-b4d5-88c14b17cf90 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:00.033570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-03ea6b46-06e3-4192-b4d5-88c14b17cf90 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:00.039878 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-03ea6b46-06e3-4192-b4d5-88c14b17cf90 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:00.040328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-03ea6b46-06e3-4192-b4d5-88c14b17cf90 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:00.041115 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-03ea6b46-06e3-4192-b4d5-88c14b17cf90 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:00.041554 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-03ea6b46-06e3-4192-b4d5-88c14b17cf90 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:00.119385 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-03ea6b46-06e3-4192-b4d5-88c14b17cf90 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:00.127574 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-03ea6b46-06e3-4192-b4d5-88c14b17cf90 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1266 microversion: 2.1 time: 0.100977 Jun 02 13:55:00.128203 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 86/164] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:00 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:00.132548 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-65cc5836-aa2d-4bf1-a4a6-adee3bb98dcc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:00.133157 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-65cc5836-aa2d-4bf1-a4a6-adee3bb98dcc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:00.138805 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-65cc5836-aa2d-4bf1-a4a6-adee3bb98dcc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:00.139232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-65cc5836-aa2d-4bf1-a4a6-adee3bb98dcc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:00.139980 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-65cc5836-aa2d-4bf1-a4a6-adee3bb98dcc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:00.141070 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-65cc5836-aa2d-4bf1-a4a6-adee3bb98dcc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:00.269256 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-65cc5836-aa2d-4bf1-a4a6-adee3bb98dcc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:00.276693 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-65cc5836-aa2d-4bf1-a4a6-adee3bb98dcc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.147487 Jun 02 13:55:00.277258 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 87/165] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:00 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:01.145019 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4eb0a87f-3121-45e4-a0b2-d3563cd9a61f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:01.145675 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4eb0a87f-3121-45e4-a0b2-d3563cd9a61f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:01.151855 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4eb0a87f-3121-45e4-a0b2-d3563cd9a61f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:01.156825 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4eb0a87f-3121-45e4-a0b2-d3563cd9a61f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:01.156825 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4eb0a87f-3121-45e4-a0b2-d3563cd9a61f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:01.156825 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4eb0a87f-3121-45e4-a0b2-d3563cd9a61f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:01.215967 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4eb0a87f-3121-45e4-a0b2-d3563cd9a61f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:01.224432 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4eb0a87f-3121-45e4-a0b2-d3563cd9a61f tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1266 microversion: 2.1 time: 0.083191 Jun 02 13:55:01.225059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 88/166] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:01 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:01.294627 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-03a3e833-16e2-4eec-81a5-173ab38766a7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:01.295286 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-03a3e833-16e2-4eec-81a5-173ab38766a7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:01.302247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-03a3e833-16e2-4eec-81a5-173ab38766a7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:01.302653 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-03a3e833-16e2-4eec-81a5-173ab38766a7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:01.303412 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-03a3e833-16e2-4eec-81a5-173ab38766a7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:01.303906 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-03a3e833-16e2-4eec-81a5-173ab38766a7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:01.441022 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-03a3e833-16e2-4eec-81a5-173ab38766a7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:01.448305 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-03a3e833-16e2-4eec-81a5-173ab38766a7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.157635 Jun 02 13:55:01.448919 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 89/167] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:01 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:02.241804 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-de0c9f22-fa5b-4621-a53e-b7f54682c07b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:02.244731 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-de0c9f22-fa5b-4621-a53e-b7f54682c07b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:02.252162 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-de0c9f22-fa5b-4621-a53e-b7f54682c07b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:02.252784 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-de0c9f22-fa5b-4621-a53e-b7f54682c07b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:02.254395 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-de0c9f22-fa5b-4621-a53e-b7f54682c07b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:02.254922 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-de0c9f22-fa5b-4621-a53e-b7f54682c07b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:02.323321 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-de0c9f22-fa5b-4621-a53e-b7f54682c07b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:02.331575 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-de0c9f22-fa5b-4621-a53e-b7f54682c07b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1266 microversion: 2.1 time: 0.093701 Jun 02 13:55:02.332152 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 90/168] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:02 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:02.466173 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d781d5d7-dafd-4438-b4ea-aaba225fb197 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:02.466790 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d781d5d7-dafd-4438-b4ea-aaba225fb197 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:02.474209 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d781d5d7-dafd-4438-b4ea-aaba225fb197 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:02.474657 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d781d5d7-dafd-4438-b4ea-aaba225fb197 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:02.475970 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d781d5d7-dafd-4438-b4ea-aaba225fb197 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:02.476623 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d781d5d7-dafd-4438-b4ea-aaba225fb197 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:02.621048 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d781d5d7-dafd-4438-b4ea-aaba225fb197 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:02.628985 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d781d5d7-dafd-4438-b4ea-aaba225fb197 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.166651 Jun 02 13:55:02.629907 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 91/169] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:02 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:03.349433 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a0c0992f-283d-495a-b2ec-6390f5510649 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:03.350051 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a0c0992f-283d-495a-b2ec-6390f5510649 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:03.356053 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a0c0992f-283d-495a-b2ec-6390f5510649 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:03.356535 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a0c0992f-283d-495a-b2ec-6390f5510649 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:03.357286 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a0c0992f-283d-495a-b2ec-6390f5510649 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:03.357717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a0c0992f-283d-495a-b2ec-6390f5510649 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:03.362470 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:03.424488 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a0c0992f-283d-495a-b2ec-6390f5510649 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:03.432332 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a0c0992f-283d-495a-b2ec-6390f5510649 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1266 microversion: 2.1 time: 0.086872 Jun 02 13:55:03.432925 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 92/170] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:03 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:03.647483 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ac022a90-cb17-4ce7-ba70-ef51778250a5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:03.648013 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ac022a90-cb17-4ce7-ba70-ef51778250a5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:03.654128 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ac022a90-cb17-4ce7-ba70-ef51778250a5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:03.654577 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ac022a90-cb17-4ce7-ba70-ef51778250a5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:03.655335 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ac022a90-cb17-4ce7-ba70-ef51778250a5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:03.655766 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ac022a90-cb17-4ce7-ba70-ef51778250a5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:03.788582 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ac022a90-cb17-4ce7-ba70-ef51778250a5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:03.796139 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ac022a90-cb17-4ce7-ba70-ef51778250a5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.152888 Jun 02 13:55:03.797242 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 93/171] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:03 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:04.450399 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c066771c-3b0a-45bd-9ac6-33609cebf9d7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:04.451092 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c066771c-3b0a-45bd-9ac6-33609cebf9d7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:04.457895 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c066771c-3b0a-45bd-9ac6-33609cebf9d7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:04.458335 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c066771c-3b0a-45bd-9ac6-33609cebf9d7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:04.459088 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c066771c-3b0a-45bd-9ac6-33609cebf9d7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:04.459512 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c066771c-3b0a-45bd-9ac6-33609cebf9d7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:04.530567 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c066771c-3b0a-45bd-9ac6-33609cebf9d7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:04.538853 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c066771c-3b0a-45bd-9ac6-33609cebf9d7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1274 microversion: 2.1 time: 0.092618 Jun 02 13:55:04.539472 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 94/172] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:04 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:04.814828 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-dcdca8e0-e6b0-452a-a4c4-7a437bafd848 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:04.815550 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-dcdca8e0-e6b0-452a-a4c4-7a437bafd848 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:04.823140 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dcdca8e0-e6b0-452a-a4c4-7a437bafd848 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:04.823578 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dcdca8e0-e6b0-452a-a4c4-7a437bafd848 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:04.825230 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dcdca8e0-e6b0-452a-a4c4-7a437bafd848 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:04.825662 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dcdca8e0-e6b0-452a-a4c4-7a437bafd848 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:04.826149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=2 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:04.851757 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=6 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:04.965690 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-cf3fc922-e63f-46d4-9954-f95d72f988c1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "POST /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.170660 Jun 02 13:55:04.971666 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 79/173] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 2 13:54:58 2022] POST /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be/os-volume_attachments => generated 194 bytes in 6172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:55:04.972271 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-dcdca8e0-e6b0-452a-a4c4-7a437bafd848 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:04.979787 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-dcdca8e0-e6b0-452a-a4c4-7a437bafd848 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.169856 Jun 02 13:55:04.980353 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 95/174] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:04 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:05.556842 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f22c1727-d549-4f2b-8098-a634f3d08511 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:05.557575 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f22c1727-d549-4f2b-8098-a634f3d08511 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:05.565534 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f22c1727-d549-4f2b-8098-a634f3d08511 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:05.565986 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f22c1727-d549-4f2b-8098-a634f3d08511 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:05.566761 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f22c1727-d549-4f2b-8098-a634f3d08511 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:05.567195 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f22c1727-d549-4f2b-8098-a634f3d08511 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:05.645513 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f22c1727-d549-4f2b-8098-a634f3d08511 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:05.653436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f22c1727-d549-4f2b-8098-a634f3d08511 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1272 microversion: 2.1 time: 0.100898 Jun 02 13:55:05.654112 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 80/175] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:05 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1272 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:05.997024 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-fe50b3e9-8fe4-4166-abbe-426c3efcf756 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:05.997631 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-fe50b3e9-8fe4-4166-abbe-426c3efcf756 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:06.003681 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe50b3e9-8fe4-4166-abbe-426c3efcf756 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:06.004122 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe50b3e9-8fe4-4166-abbe-426c3efcf756 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:06.004894 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe50b3e9-8fe4-4166-abbe-426c3efcf756 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:06.005320 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe50b3e9-8fe4-4166-abbe-426c3efcf756 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:06.179034 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-fe50b3e9-8fe4-4166-abbe-426c3efcf756 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:06.189828 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-fe50b3e9-8fe4-4166-abbe-426c3efcf756 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.195976 Jun 02 13:55:06.190653 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 96/176] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:05 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:06.671456 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3561093e-1660-4303-9820-3b74977cbc51 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:06.672836 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3561093e-1660-4303-9820-3b74977cbc51 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:06.683151 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3561093e-1660-4303-9820-3b74977cbc51 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:06.683639 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3561093e-1660-4303-9820-3b74977cbc51 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:06.684470 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3561093e-1660-4303-9820-3b74977cbc51 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:06.684900 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3561093e-1660-4303-9820-3b74977cbc51 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:06.827208 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3561093e-1660-4303-9820-3b74977cbc51 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:06.835549 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3561093e-1660-4303-9820-3b74977cbc51 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.168343 Jun 02 13:55:06.836128 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 81/177] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:06 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:06.920683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-433603d8-a6c4-45b3-ba9a-6e463fe8f5c5 req-68850d43-03ff-42a7-b8f1-bdfc363bebd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd39a90-54ba-413c-a63f-54c1e26b7c48", "tag": "78656f18-3d14-4ddc-adde-5ec85a2d24aa"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:55:06.927562 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=4 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:06.941174 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-433603d8-a6c4-45b3-ba9a-6e463fe8f5c5 req-68850d43-03ff-42a7-b8f1-bdfc363bebd0 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:06.941618 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-433603d8-a6c4-45b3-ba9a-6e463fe8f5c5 req-68850d43-03ff-42a7-b8f1-bdfc363bebd0 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:06.958251 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-433603d8-a6c4-45b3-ba9a-6e463fe8f5c5 req-68850d43-03ff-42a7-b8f1-bdfc363bebd0 service nova] Creating event network-changed:78656f18-3d14-4ddc-adde-5ec85a2d24aa for instance fdd39a90-54ba-413c-a63f-54c1e26b7c48 on hv-cinder-82651 Jun 02 13:55:06.964350 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-433603d8-a6c4-45b3-ba9a-6e463fe8f5c5 req-68850d43-03ff-42a7-b8f1-bdfc363bebd0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047874 Jun 02 13:55:06.965361 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 97/178] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:55:07.207282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ac959edd-46f8-44b6-81af-0d24f6a1a00d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:07.208000 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ac959edd-46f8-44b6-81af-0d24f6a1a00d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:07.214411 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ac959edd-46f8-44b6-81af-0d24f6a1a00d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:07.215176 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ac959edd-46f8-44b6-81af-0d24f6a1a00d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:07.216105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ac959edd-46f8-44b6-81af-0d24f6a1a00d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:07.216728 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ac959edd-46f8-44b6-81af-0d24f6a1a00d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:07.354281 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ac959edd-46f8-44b6-81af-0d24f6a1a00d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:07.362775 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ac959edd-46f8-44b6-81af-0d24f6a1a00d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.159627 Jun 02 13:55:07.367752 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 82/179] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:07 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:07.852782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8e5775d1-a6e3-43a1-83a5-05b36d5805a2 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:07.853485 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8e5775d1-a6e3-43a1-83a5-05b36d5805a2 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:07.859838 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e5775d1-a6e3-43a1-83a5-05b36d5805a2 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:07.860361 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e5775d1-a6e3-43a1-83a5-05b36d5805a2 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:07.861160 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e5775d1-a6e3-43a1-83a5-05b36d5805a2 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:07.861601 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e5775d1-a6e3-43a1-83a5-05b36d5805a2 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:07.998449 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8e5775d1-a6e3-43a1-83a5-05b36d5805a2 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:08.006739 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8e5775d1-a6e3-43a1-83a5-05b36d5805a2 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.158590 Jun 02 13:55:08.007318 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 98/180] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:07 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:08.380007 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2c602a39-ef3f-48b6-b47d-385efa8e0358 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:08.380574 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-2c602a39-ef3f-48b6-b47d-385efa8e0358 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:08.387113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2c602a39-ef3f-48b6-b47d-385efa8e0358 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:08.387559 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2c602a39-ef3f-48b6-b47d-385efa8e0358 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:08.388367 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2c602a39-ef3f-48b6-b47d-385efa8e0358 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:08.388829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2c602a39-ef3f-48b6-b47d-385efa8e0358 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:08.518528 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2c602a39-ef3f-48b6-b47d-385efa8e0358 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:08.525961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2c602a39-ef3f-48b6-b47d-385efa8e0358 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.149872 Jun 02 13:55:08.526526 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 83/181] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:08 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:09.022896 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-45a7675b-8831-42aa-867a-dd2cd417b826 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:09.023512 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-45a7675b-8831-42aa-867a-dd2cd417b826 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:09.029579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-45a7675b-8831-42aa-867a-dd2cd417b826 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:09.030025 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-45a7675b-8831-42aa-867a-dd2cd417b826 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:09.030777 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-45a7675b-8831-42aa-867a-dd2cd417b826 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:09.031844 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-45a7675b-8831-42aa-867a-dd2cd417b826 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:09.159605 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-45a7675b-8831-42aa-867a-dd2cd417b826 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:09.167342 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-45a7675b-8831-42aa-867a-dd2cd417b826 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.148233 Jun 02 13:55:09.167910 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 99/182] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:09 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:09.543027 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d555720d-5547-479c-9eed-b201b8bbf3be tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:09.543632 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d555720d-5547-479c-9eed-b201b8bbf3be tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:09.550600 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d555720d-5547-479c-9eed-b201b8bbf3be tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:09.551040 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d555720d-5547-479c-9eed-b201b8bbf3be tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:09.551784 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d555720d-5547-479c-9eed-b201b8bbf3be tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:09.552210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d555720d-5547-479c-9eed-b201b8bbf3be tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:09.686227 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d555720d-5547-479c-9eed-b201b8bbf3be tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:09.694644 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d555720d-5547-479c-9eed-b201b8bbf3be tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.155457 Jun 02 13:55:09.695219 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 84/183] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:09 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:10.185273 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-bf7145c7-0205-412a-aad7-dce0547d719c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:10.185883 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-bf7145c7-0205-412a-aad7-dce0547d719c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:10.192123 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bf7145c7-0205-412a-aad7-dce0547d719c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:10.192599 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bf7145c7-0205-412a-aad7-dce0547d719c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:10.193348 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bf7145c7-0205-412a-aad7-dce0547d719c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:10.193776 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bf7145c7-0205-412a-aad7-dce0547d719c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:10.322809 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-bf7145c7-0205-412a-aad7-dce0547d719c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:10.330951 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-bf7145c7-0205-412a-aad7-dce0547d719c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.149524 Jun 02 13:55:10.331514 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 100/184] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:10 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:10.710907 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-aa7e185d-7534-4a4e-a7ec-b96b2fcd1601 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:10.711610 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-aa7e185d-7534-4a4e-a7ec-b96b2fcd1601 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:10.718153 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-aa7e185d-7534-4a4e-a7ec-b96b2fcd1601 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:10.718646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-aa7e185d-7534-4a4e-a7ec-b96b2fcd1601 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:10.719675 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-aa7e185d-7534-4a4e-a7ec-b96b2fcd1601 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:10.720141 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-aa7e185d-7534-4a4e-a7ec-b96b2fcd1601 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:10.858122 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-aa7e185d-7534-4a4e-a7ec-b96b2fcd1601 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:10.865730 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-aa7e185d-7534-4a4e-a7ec-b96b2fcd1601 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.158654 Jun 02 13:55:10.866310 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 85/185] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:10 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:11.347929 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-63df46ee-3d0c-4d26-9ac9-aff1a87ab155 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:11.348536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-63df46ee-3d0c-4d26-9ac9-aff1a87ab155 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:11.354471 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-63df46ee-3d0c-4d26-9ac9-aff1a87ab155 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:11.354911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-63df46ee-3d0c-4d26-9ac9-aff1a87ab155 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:11.355659 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-63df46ee-3d0c-4d26-9ac9-aff1a87ab155 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:11.356086 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-63df46ee-3d0c-4d26-9ac9-aff1a87ab155 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:11.483027 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-63df46ee-3d0c-4d26-9ac9-aff1a87ab155 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:11.493480 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-63df46ee-3d0c-4d26-9ac9-aff1a87ab155 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.149586 Jun 02 13:55:11.496996 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 101/186] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:11 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:11.882000 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d7c6bc04-2218-4922-b169-b17956b9b834 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:11.882605 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d7c6bc04-2218-4922-b169-b17956b9b834 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:11.888986 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d7c6bc04-2218-4922-b169-b17956b9b834 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:11.889430 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d7c6bc04-2218-4922-b169-b17956b9b834 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:11.890178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d7c6bc04-2218-4922-b169-b17956b9b834 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:11.891274 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d7c6bc04-2218-4922-b169-b17956b9b834 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:12.018383 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d7c6bc04-2218-4922-b169-b17956b9b834 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:12.025871 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d7c6bc04-2218-4922-b169-b17956b9b834 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.147648 Jun 02 13:55:12.026438 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 86/187] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:11 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:12.511216 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-21d6fbb0-4838-4163-bfbe-8ae9d9aa91b0 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:12.511821 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-21d6fbb0-4838-4163-bfbe-8ae9d9aa91b0 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:12.517968 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21d6fbb0-4838-4163-bfbe-8ae9d9aa91b0 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:12.518481 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21d6fbb0-4838-4163-bfbe-8ae9d9aa91b0 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:12.519809 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21d6fbb0-4838-4163-bfbe-8ae9d9aa91b0 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:12.520496 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21d6fbb0-4838-4163-bfbe-8ae9d9aa91b0 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:12.651886 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-21d6fbb0-4838-4163-bfbe-8ae9d9aa91b0 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:12.659615 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-21d6fbb0-4838-4163-bfbe-8ae9d9aa91b0 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.152366 Jun 02 13:55:12.660191 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 102/188] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:12 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:13.043043 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-bd782464-66e1-4849-9716-18c90444796b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:13.043769 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-bd782464-66e1-4849-9716-18c90444796b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:13.051269 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd782464-66e1-4849-9716-18c90444796b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:13.051720 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd782464-66e1-4849-9716-18c90444796b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:13.052541 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd782464-66e1-4849-9716-18c90444796b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:13.052978 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd782464-66e1-4849-9716-18c90444796b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:13.071593 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:13.186161 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-bd782464-66e1-4849-9716-18c90444796b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:13.194469 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-bd782464-66e1-4849-9716-18c90444796b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.155239 Jun 02 13:55:13.195152 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 87/189] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:13 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:13.676580 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7961ddc1-83f1-45c7-b79e-9728046428a8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:13.677187 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7961ddc1-83f1-45c7-b79e-9728046428a8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:13.683168 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7961ddc1-83f1-45c7-b79e-9728046428a8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:13.683607 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7961ddc1-83f1-45c7-b79e-9728046428a8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:13.684347 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7961ddc1-83f1-45c7-b79e-9728046428a8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:13.684796 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7961ddc1-83f1-45c7-b79e-9728046428a8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:13.817417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7961ddc1-83f1-45c7-b79e-9728046428a8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:13.825049 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7961ddc1-83f1-45c7-b79e-9728046428a8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.152227 Jun 02 13:55:13.827128 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 103/190] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:13 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:14.211613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-90b797e4-30bb-48e4-b8b5-b913882464de tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:14.212304 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-90b797e4-30bb-48e4-b8b5-b913882464de tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:14.219286 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-90b797e4-30bb-48e4-b8b5-b913882464de tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:14.219733 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-90b797e4-30bb-48e4-b8b5-b913882464de tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:14.220562 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-90b797e4-30bb-48e4-b8b5-b913882464de tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:14.221812 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-90b797e4-30bb-48e4-b8b5-b913882464de tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:14.360796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-90b797e4-30bb-48e4-b8b5-b913882464de tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:14.368288 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-90b797e4-30bb-48e4-b8b5-b913882464de tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.160562 Jun 02 13:55:14.368870 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 88/191] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:14 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:14.843859 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-54eb61c2-6344-4afb-9457-4aee14b40da6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:14.844431 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-54eb61c2-6344-4afb-9457-4aee14b40da6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:14.851567 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-54eb61c2-6344-4afb-9457-4aee14b40da6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:14.856052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-54eb61c2-6344-4afb-9457-4aee14b40da6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:14.856337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-54eb61c2-6344-4afb-9457-4aee14b40da6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:14.856811 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-54eb61c2-6344-4afb-9457-4aee14b40da6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:14.995810 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-54eb61c2-6344-4afb-9457-4aee14b40da6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:15.003981 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-54eb61c2-6344-4afb-9457-4aee14b40da6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.164205 Jun 02 13:55:15.004586 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 104/192] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:14 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:15.385062 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5943fe90-f804-449f-9c4a-8eb7584309c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:15.385868 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5943fe90-f804-449f-9c4a-8eb7584309c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:15.392194 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5943fe90-f804-449f-9c4a-8eb7584309c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:15.393697 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5943fe90-f804-449f-9c4a-8eb7584309c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:15.394362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5943fe90-f804-449f-9c4a-8eb7584309c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:15.394869 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5943fe90-f804-449f-9c4a-8eb7584309c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:15.529556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5943fe90-f804-449f-9c4a-8eb7584309c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:15.537405 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5943fe90-f804-449f-9c4a-8eb7584309c2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.156091 Jun 02 13:55:15.537983 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 89/193] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:15 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:16.022280 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-35fbb64c-29e8-4777-b133-b3cc3c24d33c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:16.023023 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-35fbb64c-29e8-4777-b133-b3cc3c24d33c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:16.028991 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-35fbb64c-29e8-4777-b133-b3cc3c24d33c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:16.029443 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-35fbb64c-29e8-4777-b133-b3cc3c24d33c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:16.030217 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-35fbb64c-29e8-4777-b133-b3cc3c24d33c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:16.030649 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-35fbb64c-29e8-4777-b133-b3cc3c24d33c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:16.176900 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-35fbb64c-29e8-4777-b133-b3cc3c24d33c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:16.184476 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-35fbb64c-29e8-4777-b133-b3cc3c24d33c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.166296 Jun 02 13:55:16.185143 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 105/194] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:16 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:16.554342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7e5937f6-bc29-43dd-a947-406bb573074d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:16.555228 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7e5937f6-bc29-43dd-a947-406bb573074d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:16.562101 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7e5937f6-bc29-43dd-a947-406bb573074d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:16.562931 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7e5937f6-bc29-43dd-a947-406bb573074d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:16.563550 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7e5937f6-bc29-43dd-a947-406bb573074d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:16.564076 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7e5937f6-bc29-43dd-a947-406bb573074d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:16.700411 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7e5937f6-bc29-43dd-a947-406bb573074d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:16.708757 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7e5937f6-bc29-43dd-a947-406bb573074d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.158360 Jun 02 13:55:16.709327 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 90/195] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:16 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:17.209518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-27940855-11c0-455b-be56-0d561ab3693d tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:17.209518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-27940855-11c0-455b-be56-0d561ab3693d tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:17.209518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-27940855-11c0-455b-be56-0d561ab3693d tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:17.209518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-27940855-11c0-455b-be56-0d561ab3693d tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:17.210625 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-27940855-11c0-455b-be56-0d561ab3693d tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:17.210625 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-27940855-11c0-455b-be56-0d561ab3693d tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:17.351272 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-27940855-11c0-455b-be56-0d561ab3693d tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:17.359027 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-27940855-11c0-455b-be56-0d561ab3693d tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.161294 Jun 02 13:55:17.370348 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 106/196] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:17 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:17.725825 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3c2f4987-d299-4252-bf4f-17fe9e613210 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:17.726436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3c2f4987-d299-4252-bf4f-17fe9e613210 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:17.733079 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3c2f4987-d299-4252-bf4f-17fe9e613210 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:17.733528 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3c2f4987-d299-4252-bf4f-17fe9e613210 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:17.734285 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3c2f4987-d299-4252-bf4f-17fe9e613210 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:17.734719 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3c2f4987-d299-4252-bf4f-17fe9e613210 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:17.884776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3c2f4987-d299-4252-bf4f-17fe9e613210 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:17.892322 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3c2f4987-d299-4252-bf4f-17fe9e613210 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.171263 Jun 02 13:55:17.893561 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 91/197] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:17 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:18.376811 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-1a876ab2-1af9-4698-b2b2-87666836ddd1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:18.377979 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-1a876ab2-1af9-4698-b2b2-87666836ddd1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:18.384011 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1a876ab2-1af9-4698-b2b2-87666836ddd1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:18.384484 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1a876ab2-1af9-4698-b2b2-87666836ddd1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:18.385252 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1a876ab2-1af9-4698-b2b2-87666836ddd1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:18.385681 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1a876ab2-1af9-4698-b2b2-87666836ddd1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:18.521423 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1a876ab2-1af9-4698-b2b2-87666836ddd1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:18.529564 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-1a876ab2-1af9-4698-b2b2-87666836ddd1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.156361 Jun 02 13:55:18.530268 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 107/198] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:18 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:18.910843 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-05eee0a2-ae67-4bcf-a8fb-fe26f3b5f113 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:18.911454 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-05eee0a2-ae67-4bcf-a8fb-fe26f3b5f113 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:18.914995 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:18.918472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-05eee0a2-ae67-4bcf-a8fb-fe26f3b5f113 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:18.918919 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-05eee0a2-ae67-4bcf-a8fb-fe26f3b5f113 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:18.919692 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-05eee0a2-ae67-4bcf-a8fb-fe26f3b5f113 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:18.920151 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-05eee0a2-ae67-4bcf-a8fb-fe26f3b5f113 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:19.061402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-05eee0a2-ae67-4bcf-a8fb-fe26f3b5f113 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:19.069549 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-05eee0a2-ae67-4bcf-a8fb-fe26f3b5f113 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.163530 Jun 02 13:55:19.070198 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 92/199] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:18 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:19.548276 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4f8c9c83-c366-48c3-96d9-cb8fc727dfff tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:19.549090 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4f8c9c83-c366-48c3-96d9-cb8fc727dfff tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:19.555736 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4f8c9c83-c366-48c3-96d9-cb8fc727dfff tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:19.556033 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4f8c9c83-c366-48c3-96d9-cb8fc727dfff tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:19.556854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4f8c9c83-c366-48c3-96d9-cb8fc727dfff tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:19.557218 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4f8c9c83-c366-48c3-96d9-cb8fc727dfff tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:19.708087 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4f8c9c83-c366-48c3-96d9-cb8fc727dfff tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:19.720529 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4f8c9c83-c366-48c3-96d9-cb8fc727dfff tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.171171 Jun 02 13:55:19.720529 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 108/200] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:19 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:20.086619 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fb184564-f5e9-4785-bfd5-b5bd9a62068b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:20.087233 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-fb184564-f5e9-4785-bfd5-b5bd9a62068b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:20.093627 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fb184564-f5e9-4785-bfd5-b5bd9a62068b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:20.094067 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fb184564-f5e9-4785-bfd5-b5bd9a62068b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:20.094832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fb184564-f5e9-4785-bfd5-b5bd9a62068b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:20.095263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fb184564-f5e9-4785-bfd5-b5bd9a62068b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:20.232363 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-fb184564-f5e9-4785-bfd5-b5bd9a62068b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:20.241044 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-fb184564-f5e9-4785-bfd5-b5bd9a62068b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.158210 Jun 02 13:55:20.241619 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 93/201] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:20 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:20.742606 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-332ee9b1-f5ce-4081-9aae-5504fcf7167b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:20.746291 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-332ee9b1-f5ce-4081-9aae-5504fcf7167b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:20.749191 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-332ee9b1-f5ce-4081-9aae-5504fcf7167b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:20.749633 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-332ee9b1-f5ce-4081-9aae-5504fcf7167b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:20.750386 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-332ee9b1-f5ce-4081-9aae-5504fcf7167b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:20.750869 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-332ee9b1-f5ce-4081-9aae-5504fcf7167b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:20.769483 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:20.896082 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-332ee9b1-f5ce-4081-9aae-5504fcf7167b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:20.903494 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-332ee9b1-f5ce-4081-9aae-5504fcf7167b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.164973 Jun 02 13:55:20.904066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 109/202] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:20 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:21.259451 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a8f28971-dec9-4ef9-93bb-99b9e537b7a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:21.260034 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a8f28971-dec9-4ef9-93bb-99b9e537b7a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:21.266486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8f28971-dec9-4ef9-93bb-99b9e537b7a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:21.266928 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8f28971-dec9-4ef9-93bb-99b9e537b7a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:21.268856 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8f28971-dec9-4ef9-93bb-99b9e537b7a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:21.269318 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8f28971-dec9-4ef9-93bb-99b9e537b7a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:21.401330 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a8f28971-dec9-4ef9-93bb-99b9e537b7a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:21.409306 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a8f28971-dec9-4ef9-93bb-99b9e537b7a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.153234 Jun 02 13:55:21.409879 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 94/203] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:21 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:21.979898 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c6129084-abd9-4e35-bbc0-0ed824634886 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:21.980528 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c6129084-abd9-4e35-bbc0-0ed824634886 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:21.987089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6129084-abd9-4e35-bbc0-0ed824634886 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:21.987531 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6129084-abd9-4e35-bbc0-0ed824634886 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:21.988273 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6129084-abd9-4e35-bbc0-0ed824634886 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:21.988728 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6129084-abd9-4e35-bbc0-0ed824634886 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:22.118588 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c6129084-abd9-4e35-bbc0-0ed824634886 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:22.125900 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c6129084-abd9-4e35-bbc0-0ed824634886 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.149886 Jun 02 13:55:22.126456 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 110/204] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:21 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:22.425902 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-44525110-502b-4f4f-9fb7-f0a5eeecf41b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:22.426547 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-44525110-502b-4f4f-9fb7-f0a5eeecf41b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:22.432951 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-44525110-502b-4f4f-9fb7-f0a5eeecf41b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:22.433395 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-44525110-502b-4f4f-9fb7-f0a5eeecf41b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:22.434144 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-44525110-502b-4f4f-9fb7-f0a5eeecf41b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:22.434573 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-44525110-502b-4f4f-9fb7-f0a5eeecf41b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:22.564953 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-44525110-502b-4f4f-9fb7-f0a5eeecf41b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:22.572664 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-44525110-502b-4f4f-9fb7-f0a5eeecf41b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.150501 Jun 02 13:55:22.573169 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 95/205] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:22 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:23.142815 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-453a9f63-6856-4a17-8cb5-17f6a7419d82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:23.143430 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-453a9f63-6856-4a17-8cb5-17f6a7419d82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:23.149363 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-453a9f63-6856-4a17-8cb5-17f6a7419d82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:23.155878 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-453a9f63-6856-4a17-8cb5-17f6a7419d82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:23.155878 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-453a9f63-6856-4a17-8cb5-17f6a7419d82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:23.155878 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-453a9f63-6856-4a17-8cb5-17f6a7419d82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:23.305246 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-453a9f63-6856-4a17-8cb5-17f6a7419d82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:23.311240 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-453a9f63-6856-4a17-8cb5-17f6a7419d82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.172334 Jun 02 13:55:23.311809 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 111/206] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:23 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:23.325258 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-c5caccae-c7be-43a8-a714-323492e32538 req-0ea9b257-1606-43c7-9e7f-42c8be4c202f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd39a90-54ba-413c-a63f-54c1e26b7c48", "name": "network-vif-plugged", "status": "completed", "tag": "78656f18-3d14-4ddc-adde-5ec85a2d24aa"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:55:23.334148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-c5caccae-c7be-43a8-a714-323492e32538 req-0ea9b257-1606-43c7-9e7f-42c8be4c202f service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:23.334885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-c5caccae-c7be-43a8-a714-323492e32538 req-0ea9b257-1606-43c7-9e7f-42c8be4c202f service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:23.347062 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-c5caccae-c7be-43a8-a714-323492e32538 req-0ea9b257-1606-43c7-9e7f-42c8be4c202f service nova] Creating event network-vif-plugged:78656f18-3d14-4ddc-adde-5ec85a2d24aa for instance fdd39a90-54ba-413c-a63f-54c1e26b7c48 on hv-cinder-82651 Jun 02 13:55:23.352221 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-c5caccae-c7be-43a8-a714-323492e32538 req-0ea9b257-1606-43c7-9e7f-42c8be4c202f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030836 Jun 02 13:55:23.352840 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 96/207] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:55:23.589626 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5565a334-18b6-4399-8233-56534ccb4dad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:23.590145 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-5565a334-18b6-4399-8233-56534ccb4dad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:23.596729 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5565a334-18b6-4399-8233-56534ccb4dad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:23.597194 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5565a334-18b6-4399-8233-56534ccb4dad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:23.597936 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5565a334-18b6-4399-8233-56534ccb4dad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:23.598359 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5565a334-18b6-4399-8233-56534ccb4dad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:23.728494 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5565a334-18b6-4399-8233-56534ccb4dad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:23.737456 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5565a334-18b6-4399-8233-56534ccb4dad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.151481 Jun 02 13:55:23.738040 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 112/208] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:23 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:24.331046 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1683e7f4-69fb-41b2-97a8-3f08b2e23c80 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:24.331770 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1683e7f4-69fb-41b2-97a8-3f08b2e23c80 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:24.338102 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1683e7f4-69fb-41b2-97a8-3f08b2e23c80 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:24.338583 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1683e7f4-69fb-41b2-97a8-3f08b2e23c80 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:24.339340 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1683e7f4-69fb-41b2-97a8-3f08b2e23c80 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:24.339774 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1683e7f4-69fb-41b2-97a8-3f08b2e23c80 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:24.477846 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1683e7f4-69fb-41b2-97a8-3f08b2e23c80 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:24.489338 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1683e7f4-69fb-41b2-97a8-3f08b2e23c80 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.159994 Jun 02 13:55:24.490009 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 97/209] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:24 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:24.755636 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-bae083dd-3ae2-435c-9910-9c93bbc90121 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:24.756253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-bae083dd-3ae2-435c-9910-9c93bbc90121 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:24.762397 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bae083dd-3ae2-435c-9910-9c93bbc90121 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:24.762841 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bae083dd-3ae2-435c-9910-9c93bbc90121 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:24.763595 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bae083dd-3ae2-435c-9910-9c93bbc90121 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:24.764025 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bae083dd-3ae2-435c-9910-9c93bbc90121 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:24.899126 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-bae083dd-3ae2-435c-9910-9c93bbc90121 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:24.906800 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-bae083dd-3ae2-435c-9910-9c93bbc90121 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.156339 Jun 02 13:55:24.907371 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 113/210] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:24 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:25.506205 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4402f1c4-384e-4931-a056-46c3e84f6112 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:25.506809 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4402f1c4-384e-4931-a056-46c3e84f6112 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:25.513308 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4402f1c4-384e-4931-a056-46c3e84f6112 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:25.513783 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4402f1c4-384e-4931-a056-46c3e84f6112 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:25.514510 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4402f1c4-384e-4931-a056-46c3e84f6112 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:25.514927 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4402f1c4-384e-4931-a056-46c3e84f6112 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:25.647365 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4402f1c4-384e-4931-a056-46c3e84f6112 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:25.654768 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4402f1c4-384e-4931-a056-46c3e84f6112 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.152730 Jun 02 13:55:25.655330 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 98/211] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:25 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:25.923081 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-61e3af36-85ff-43a4-ade1-e28dd9e3c513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:25.923686 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-61e3af36-85ff-43a4-ade1-e28dd9e3c513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:25.929638 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-61e3af36-85ff-43a4-ade1-e28dd9e3c513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:25.930096 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-61e3af36-85ff-43a4-ade1-e28dd9e3c513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:25.930849 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-61e3af36-85ff-43a4-ade1-e28dd9e3c513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:25.931270 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-61e3af36-85ff-43a4-ade1-e28dd9e3c513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:26.071742 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-61e3af36-85ff-43a4-ade1-e28dd9e3c513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:26.079428 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-61e3af36-85ff-43a4-ade1-e28dd9e3c513 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.160273 Jun 02 13:55:26.079989 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 114/212] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:25 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:26.671577 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d4edb9d8-36d7-4ff4-ad9b-4e7b530cb1ca tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:26.672281 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d4edb9d8-36d7-4ff4-ad9b-4e7b530cb1ca tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:26.679994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d4edb9d8-36d7-4ff4-ad9b-4e7b530cb1ca tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:26.680466 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d4edb9d8-36d7-4ff4-ad9b-4e7b530cb1ca tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:26.681222 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d4edb9d8-36d7-4ff4-ad9b-4e7b530cb1ca tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:26.681649 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d4edb9d8-36d7-4ff4-ad9b-4e7b530cb1ca tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:26.811709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d4edb9d8-36d7-4ff4-ad9b-4e7b530cb1ca tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:26.820190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d4edb9d8-36d7-4ff4-ad9b-4e7b530cb1ca tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.152524 Jun 02 13:55:26.820972 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 99/213] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:26 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:27.096486 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c840fc46-e0e8-4172-bb77-9ff483acd20a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:27.097170 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c840fc46-e0e8-4172-bb77-9ff483acd20a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:27.103237 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c840fc46-e0e8-4172-bb77-9ff483acd20a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:27.103679 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c840fc46-e0e8-4172-bb77-9ff483acd20a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:27.104461 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c840fc46-e0e8-4172-bb77-9ff483acd20a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:27.104899 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c840fc46-e0e8-4172-bb77-9ff483acd20a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:27.234799 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c840fc46-e0e8-4172-bb77-9ff483acd20a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:27.242369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c840fc46-e0e8-4172-bb77-9ff483acd20a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.149873 Jun 02 13:55:27.243004 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 115/214] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:27 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:27.735101 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-54059cdf-3f12-48fc-ad09-7407679d9484 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:27.735598 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-54059cdf-3f12-48fc-ad09-7407679d9484 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:27.742763 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54059cdf-3f12-48fc-ad09-7407679d9484 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:27.743212 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54059cdf-3f12-48fc-ad09-7407679d9484 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:27.744007 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54059cdf-3f12-48fc-ad09-7407679d9484 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:27.744463 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54059cdf-3f12-48fc-ad09-7407679d9484 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:27.770741 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-54059cdf-3f12-48fc-ad09-7407679d9484 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Going to try to terminate instance {{(pid=118315) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:55:27.838185 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-572e1b53-2fbe-4c1e-a035-9e6e1907f6e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:27.838875 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-572e1b53-2fbe-4c1e-a035-9e6e1907f6e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:27.845030 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-572e1b53-2fbe-4c1e-a035-9e6e1907f6e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:27.847010 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-572e1b53-2fbe-4c1e-a035-9e6e1907f6e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:27.847010 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-572e1b53-2fbe-4c1e-a035-9e6e1907f6e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:27.847259 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-572e1b53-2fbe-4c1e-a035-9e6e1907f6e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:27.996221 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-572e1b53-2fbe-4c1e-a035-9e6e1907f6e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:28.004483 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-572e1b53-2fbe-4c1e-a035-9e6e1907f6e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.170140 Jun 02 13:55:28.005060 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 116/215] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:27 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:28.118930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-54059cdf-3f12-48fc-ad09-7407679d9484 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 204 len: 0 microversion: 2.1 time: 0.387412 Jun 02 13:55:28.119682 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 100/216] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 13:55:27 2022] DELETE /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:55:28.127846 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4deea300-5566-452d-8c0c-4236c961d8d2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:28.128490 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4deea300-5566-452d-8c0c-4236c961d8d2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:28.134368 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4deea300-5566-452d-8c0c-4236c961d8d2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:28.134807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4deea300-5566-452d-8c0c-4236c961d8d2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:28.135559 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4deea300-5566-452d-8c0c-4236c961d8d2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:28.135986 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4deea300-5566-452d-8c0c-4236c961d8d2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:28.260013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0547fe39-384b-4654-bec6-c46e48347c88 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:28.260741 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0547fe39-384b-4654-bec6-c46e48347c88 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:28.266857 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0547fe39-384b-4654-bec6-c46e48347c88 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:28.270545 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4deea300-5566-452d-8c0c-4236c961d8d2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:28.270905 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0547fe39-384b-4654-bec6-c46e48347c88 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:28.271730 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0547fe39-384b-4654-bec6-c46e48347c88 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:28.272223 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0547fe39-384b-4654-bec6-c46e48347c88 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:28.278402 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4deea300-5566-452d-8c0c-4236c961d8d2 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1554 microversion: 2.1 time: 0.154480 Jun 02 13:55:28.280189 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 117/217] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:28 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:28.410384 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0547fe39-384b-4654-bec6-c46e48347c88 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:28.417971 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0547fe39-384b-4654-bec6-c46e48347c88 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.162786 Jun 02 13:55:28.418530 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 101/218] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:28 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:29.021801 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-209118d1-ec20-4754-b234-6d6276e60a82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:29.022402 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-209118d1-ec20-4754-b234-6d6276e60a82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:29.024272 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=72 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:29.028921 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-209118d1-ec20-4754-b234-6d6276e60a82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:29.029362 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-209118d1-ec20-4754-b234-6d6276e60a82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:29.030100 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-209118d1-ec20-4754-b234-6d6276e60a82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:29.030523 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-209118d1-ec20-4754-b234-6d6276e60a82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:29.159982 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-209118d1-ec20-4754-b234-6d6276e60a82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:29.167369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-209118d1-ec20-4754-b234-6d6276e60a82 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.150002 Jun 02 13:55:29.167997 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 118/219] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:29 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:29.299423 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ea16290a-2649-41b6-8ad4-cacfd73eb817 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:29.300039 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ea16290a-2649-41b6-8ad4-cacfd73eb817 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:29.306221 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ea16290a-2649-41b6-8ad4-cacfd73eb817 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:29.306668 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ea16290a-2649-41b6-8ad4-cacfd73eb817 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:29.307423 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ea16290a-2649-41b6-8ad4-cacfd73eb817 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:29.307856 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ea16290a-2649-41b6-8ad4-cacfd73eb817 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:29.437069 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ea16290a-2649-41b6-8ad4-cacfd73eb817 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:29.438765 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-403d62a6-1262-474b-b72f-d0f304c80af2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:29.440107 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-403d62a6-1262-474b-b72f-d0f304c80af2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:29.445908 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ea16290a-2649-41b6-8ad4-cacfd73eb817 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1554 microversion: 2.1 time: 0.150583 Jun 02 13:55:29.446132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-403d62a6-1262-474b-b72f-d0f304c80af2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:29.446577 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-403d62a6-1262-474b-b72f-d0f304c80af2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:29.446830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 102/220] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:29 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:29.447342 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-403d62a6-1262-474b-b72f-d0f304c80af2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:29.447766 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-403d62a6-1262-474b-b72f-d0f304c80af2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:29.584053 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-403d62a6-1262-474b-b72f-d0f304c80af2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:29.591784 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-403d62a6-1262-474b-b72f-d0f304c80af2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.156830 Jun 02 13:55:29.592348 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 119/221] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:29 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:30.184530 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0e7de516-ab32-4315-908e-b590d15224fa tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:30.185161 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0e7de516-ab32-4315-908e-b590d15224fa tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:30.191526 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0e7de516-ab32-4315-908e-b590d15224fa tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:30.191973 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0e7de516-ab32-4315-908e-b590d15224fa tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:30.192834 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0e7de516-ab32-4315-908e-b590d15224fa tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:30.193270 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0e7de516-ab32-4315-908e-b590d15224fa tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:30.197594 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:30.326395 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0e7de516-ab32-4315-908e-b590d15224fa tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:30.334144 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0e7de516-ab32-4315-908e-b590d15224fa tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.153498 Jun 02 13:55:30.334712 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 103/222] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:30 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:30.464270 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d50f0f15-0cb1-4fc6-ae2c-3c1405e7ac98 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:30.464911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d50f0f15-0cb1-4fc6-ae2c-3c1405e7ac98 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:30.471592 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d50f0f15-0cb1-4fc6-ae2c-3c1405e7ac98 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:30.472044 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d50f0f15-0cb1-4fc6-ae2c-3c1405e7ac98 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:30.472837 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d50f0f15-0cb1-4fc6-ae2c-3c1405e7ac98 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:30.473271 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d50f0f15-0cb1-4fc6-ae2c-3c1405e7ac98 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:30.608169 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d50f0f15-0cb1-4fc6-ae2c-3c1405e7ac98 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:30.609918 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7677d6af-d883-45d0-b56c-816d4a2607b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:30.610543 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7677d6af-d883-45d0-b56c-816d4a2607b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:30.617360 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d50f0f15-0cb1-4fc6-ae2c-3c1405e7ac98 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1554 microversion: 2.1 time: 0.156846 Jun 02 13:55:30.618229 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 120/223] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:30 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:30.618888 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7677d6af-d883-45d0-b56c-816d4a2607b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:30.619343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7677d6af-d883-45d0-b56c-816d4a2607b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:30.620485 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7677d6af-d883-45d0-b56c-816d4a2607b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:30.620928 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7677d6af-d883-45d0-b56c-816d4a2607b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:30.763699 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7677d6af-d883-45d0-b56c-816d4a2607b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:30.771651 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7677d6af-d883-45d0-b56c-816d4a2607b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.166450 Jun 02 13:55:30.772218 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 104/224] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:30 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:31.350666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-fe8c9e2d-b3c0-4aab-81ce-6ff1bdcccbe6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:31.351178 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-fe8c9e2d-b3c0-4aab-81ce-6ff1bdcccbe6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:31.357213 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe8c9e2d-b3c0-4aab-81ce-6ff1bdcccbe6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:31.357650 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe8c9e2d-b3c0-4aab-81ce-6ff1bdcccbe6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:31.358386 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe8c9e2d-b3c0-4aab-81ce-6ff1bdcccbe6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:31.358810 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe8c9e2d-b3c0-4aab-81ce-6ff1bdcccbe6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:31.490233 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-fe8c9e2d-b3c0-4aab-81ce-6ff1bdcccbe6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:31.497681 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-fe8c9e2d-b3c0-4aab-81ce-6ff1bdcccbe6 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.151109 Jun 02 13:55:31.498248 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 121/225] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:31 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:31.635561 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-988c6175-4c2e-41d3-8c91-5ab885df1f09 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:31.636099 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-988c6175-4c2e-41d3-8c91-5ab885df1f09 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:31.642614 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-988c6175-4c2e-41d3-8c91-5ab885df1f09 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:31.643061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-988c6175-4c2e-41d3-8c91-5ab885df1f09 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:31.643819 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-988c6175-4c2e-41d3-8c91-5ab885df1f09 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:31.644254 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-988c6175-4c2e-41d3-8c91-5ab885df1f09 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:31.771392 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-988c6175-4c2e-41d3-8c91-5ab885df1f09 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:31.779297 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-988c6175-4c2e-41d3-8c91-5ab885df1f09 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1554 microversion: 2.1 time: 0.147710 Jun 02 13:55:31.779863 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 105/226] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:31 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:31.793003 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5304a512-59fc-436c-9494-0ef5be60ea95 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:31.794383 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-5304a512-59fc-436c-9494-0ef5be60ea95 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:31.805665 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5304a512-59fc-436c-9494-0ef5be60ea95 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:31.806560 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5304a512-59fc-436c-9494-0ef5be60ea95 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:31.807711 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5304a512-59fc-436c-9494-0ef5be60ea95 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:31.808251 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5304a512-59fc-436c-9494-0ef5be60ea95 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:31.938302 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5304a512-59fc-436c-9494-0ef5be60ea95 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:31.945737 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5304a512-59fc-436c-9494-0ef5be60ea95 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.161337 Jun 02 13:55:31.950264 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 122/227] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:31 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:32.515036 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-20eca164-e257-4d8e-b1a4-6fc2dd3cd9b7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:32.515645 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-20eca164-e257-4d8e-b1a4-6fc2dd3cd9b7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:32.522505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-20eca164-e257-4d8e-b1a4-6fc2dd3cd9b7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:32.522954 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-20eca164-e257-4d8e-b1a4-6fc2dd3cd9b7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:32.523705 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-20eca164-e257-4d8e-b1a4-6fc2dd3cd9b7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:32.524147 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-20eca164-e257-4d8e-b1a4-6fc2dd3cd9b7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:32.653880 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-20eca164-e257-4d8e-b1a4-6fc2dd3cd9b7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:32.661613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-20eca164-e257-4d8e-b1a4-6fc2dd3cd9b7 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.150415 Jun 02 13:55:32.662183 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 106/228] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:32 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:32.796723 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4b3be1b0-7086-49a7-9b6c-9b2e7e50d444 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:32.797340 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4b3be1b0-7086-49a7-9b6c-9b2e7e50d444 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:32.803965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4b3be1b0-7086-49a7-9b6c-9b2e7e50d444 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:32.804426 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4b3be1b0-7086-49a7-9b6c-9b2e7e50d444 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:32.805198 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4b3be1b0-7086-49a7-9b6c-9b2e7e50d444 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:32.805632 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4b3be1b0-7086-49a7-9b6c-9b2e7e50d444 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:32.934325 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4b3be1b0-7086-49a7-9b6c-9b2e7e50d444 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:32.942976 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4b3be1b0-7086-49a7-9b6c-9b2e7e50d444 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1554 microversion: 2.1 time: 0.150161 Jun 02 13:55:32.943533 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 123/229] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:32 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:32.962961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ad518a88-1a24-438f-b6f3-6d06690fc658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:32.963506 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ad518a88-1a24-438f-b6f3-6d06690fc658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:32.969485 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ad518a88-1a24-438f-b6f3-6d06690fc658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:32.969936 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ad518a88-1a24-438f-b6f3-6d06690fc658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:32.970722 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ad518a88-1a24-438f-b6f3-6d06690fc658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:32.971159 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ad518a88-1a24-438f-b6f3-6d06690fc658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:33.107796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ad518a88-1a24-438f-b6f3-6d06690fc658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:33.116229 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ad518a88-1a24-438f-b6f3-6d06690fc658 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.157046 Jun 02 13:55:33.118697 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 107/230] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:32 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:33.679164 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0c5b0754-0baf-420b-b602-8ae1992cc204 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:33.679763 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0c5b0754-0baf-420b-b602-8ae1992cc204 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:33.685842 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0c5b0754-0baf-420b-b602-8ae1992cc204 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:33.686292 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0c5b0754-0baf-420b-b602-8ae1992cc204 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:33.694724 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0c5b0754-0baf-420b-b602-8ae1992cc204 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:33.695172 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0c5b0754-0baf-420b-b602-8ae1992cc204 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:33.825329 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0c5b0754-0baf-420b-b602-8ae1992cc204 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:33.833419 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0c5b0754-0baf-420b-b602-8ae1992cc204 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.158372 Jun 02 13:55:33.834063 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 124/231] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:33 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:33.960616 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-6c76ff79-c0b1-4ce0-a1d2-52286bac9905 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:33.961224 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-6c76ff79-c0b1-4ce0-a1d2-52286bac9905 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:33.967333 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6c76ff79-c0b1-4ce0-a1d2-52286bac9905 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:33.967773 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6c76ff79-c0b1-4ce0-a1d2-52286bac9905 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:33.968567 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6c76ff79-c0b1-4ce0-a1d2-52286bac9905 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:33.969022 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6c76ff79-c0b1-4ce0-a1d2-52286bac9905 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:34.096772 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6c76ff79-c0b1-4ce0-a1d2-52286bac9905 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:34.104814 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-6c76ff79-c0b1-4ce0-a1d2-52286bac9905 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1554 microversion: 2.1 time: 0.148478 Jun 02 13:55:34.105376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 108/232] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:33 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:34.135529 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-65e668cb-f8fa-4794-a657-9f06321c164c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:34.136143 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-65e668cb-f8fa-4794-a657-9f06321c164c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:34.142230 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-65e668cb-f8fa-4794-a657-9f06321c164c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:34.142677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-65e668cb-f8fa-4794-a657-9f06321c164c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:34.143437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-65e668cb-f8fa-4794-a657-9f06321c164c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:34.143870 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-65e668cb-f8fa-4794-a657-9f06321c164c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:34.277395 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-65e668cb-f8fa-4794-a657-9f06321c164c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:34.284899 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-65e668cb-f8fa-4794-a657-9f06321c164c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.153286 Jun 02 13:55:34.285576 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 125/233] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:34 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:34.850472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0b1f4bf2-69a7-4dd3-9351-48b5bd99b815 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:34.851091 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0b1f4bf2-69a7-4dd3-9351-48b5bd99b815 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:34.857205 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0b1f4bf2-69a7-4dd3-9351-48b5bd99b815 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:34.857647 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0b1f4bf2-69a7-4dd3-9351-48b5bd99b815 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:34.858415 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0b1f4bf2-69a7-4dd3-9351-48b5bd99b815 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:34.858844 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0b1f4bf2-69a7-4dd3-9351-48b5bd99b815 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:35.036253 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0b1f4bf2-69a7-4dd3-9351-48b5bd99b815 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:35.044441 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0b1f4bf2-69a7-4dd3-9351-48b5bd99b815 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1314 microversion: 2.1 time: 0.198292 Jun 02 13:55:35.045219 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 109/234] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:34 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:35.122232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c28b232f-e66c-4f99-aa84-d5c71dc38519 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:35.122846 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c28b232f-e66c-4f99-aa84-d5c71dc38519 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:35.129121 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c28b232f-e66c-4f99-aa84-d5c71dc38519 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:35.129565 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c28b232f-e66c-4f99-aa84-d5c71dc38519 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:35.130367 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c28b232f-e66c-4f99-aa84-d5c71dc38519 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:35.130799 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c28b232f-e66c-4f99-aa84-d5c71dc38519 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:35.134725 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:35.264582 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c28b232f-e66c-4f99-aa84-d5c71dc38519 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:35.273165 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c28b232f-e66c-4f99-aa84-d5c71dc38519 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1554 microversion: 2.1 time: 0.155134 Jun 02 13:55:35.273733 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 126/235] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:35 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:35.302154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5ab526d6-88f8-40db-8df7-ef8867a52b5b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:35.302716 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5ab526d6-88f8-40db-8df7-ef8867a52b5b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:35.308821 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5ab526d6-88f8-40db-8df7-ef8867a52b5b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:35.311175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5ab526d6-88f8-40db-8df7-ef8867a52b5b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:35.311175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5ab526d6-88f8-40db-8df7-ef8867a52b5b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:35.311175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5ab526d6-88f8-40db-8df7-ef8867a52b5b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:35.439883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5ab526d6-88f8-40db-8df7-ef8867a52b5b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:35.448176 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5ab526d6-88f8-40db-8df7-ef8867a52b5b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.150205 Jun 02 13:55:35.448776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 110/236] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:35 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:36.061932 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2ae6330d-1ca7-4490-a6da-54f6eaf786f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:36.062545 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2ae6330d-1ca7-4490-a6da-54f6eaf786f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:36.069576 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2ae6330d-1ca7-4490-a6da-54f6eaf786f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:36.070024 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2ae6330d-1ca7-4490-a6da-54f6eaf786f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:36.070789 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2ae6330d-1ca7-4490-a6da-54f6eaf786f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:36.071246 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2ae6330d-1ca7-4490-a6da-54f6eaf786f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:36.209018 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2ae6330d-1ca7-4490-a6da-54f6eaf786f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:36.217568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2ae6330d-1ca7-4490-a6da-54f6eaf786f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1463 microversion: 2.1 time: 0.159641 Jun 02 13:55:36.218136 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 127/237] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:36 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1463 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:36.290165 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-9fd1c38c-22d7-4e75-bc03-5cf9bfbdfe01 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:36.290793 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-9fd1c38c-22d7-4e75-bc03-5cf9bfbdfe01 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:36.297343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9fd1c38c-22d7-4e75-bc03-5cf9bfbdfe01 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:36.297782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9fd1c38c-22d7-4e75-bc03-5cf9bfbdfe01 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:36.298527 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9fd1c38c-22d7-4e75-bc03-5cf9bfbdfe01 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:36.298952 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9fd1c38c-22d7-4e75-bc03-5cf9bfbdfe01 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:36.404044 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-dc6c935d-abdf-47d6-b09d-e95904ead62a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:36.405120 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-dc6c935d-abdf-47d6-b09d-e95904ead62a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:36.418696 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dc6c935d-abdf-47d6-b09d-e95904ead62a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:36.419580 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dc6c935d-abdf-47d6-b09d-e95904ead62a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:36.419927 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dc6c935d-abdf-47d6-b09d-e95904ead62a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:36.420368 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dc6c935d-abdf-47d6-b09d-e95904ead62a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:36.447115 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-dc6c935d-abdf-47d6-b09d-e95904ead62a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Going to try to terminate instance {{(pid=118316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:55:36.457874 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-9fd1c38c-22d7-4e75-bc03-5cf9bfbdfe01 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:36.465941 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-9fd1c38c-22d7-4e75-bc03-5cf9bfbdfe01 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1554 microversion: 2.1 time: 0.179733 Jun 02 13:55:36.476237 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 111/238] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:36 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:36.476237 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f642f5ab-4983-44fa-9fb4-3b921b7e85e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:36.476237 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f642f5ab-4983-44fa-9fb4-3b921b7e85e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:36.478688 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f642f5ab-4983-44fa-9fb4-3b921b7e85e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:36.480565 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f642f5ab-4983-44fa-9fb4-3b921b7e85e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:36.483371 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f642f5ab-4983-44fa-9fb4-3b921b7e85e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:36.484021 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f642f5ab-4983-44fa-9fb4-3b921b7e85e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:36.666312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f642f5ab-4983-44fa-9fb4-3b921b7e85e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:36.673901 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f642f5ab-4983-44fa-9fb4-3b921b7e85e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.206212 Jun 02 13:55:36.674459 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 112/239] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:36 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:36.786409 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-dc6c935d-abdf-47d6-b09d-e95904ead62a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 204 len: 0 microversion: 2.1 time: 0.384705 Jun 02 13:55:36.791054 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 128/240] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 13:55:36 2022] DELETE /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:55:36.796601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-17a4a800-8339-43d7-8fec-dbda9325e48b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:36.797210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-17a4a800-8339-43d7-8fec-dbda9325e48b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:36.813013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-17a4a800-8339-43d7-8fec-dbda9325e48b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:36.813699 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-17a4a800-8339-43d7-8fec-dbda9325e48b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:36.817653 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-17a4a800-8339-43d7-8fec-dbda9325e48b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:36.817653 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-17a4a800-8339-43d7-8fec-dbda9325e48b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:36.968859 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-17a4a800-8339-43d7-8fec-dbda9325e48b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:36.980463 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-17a4a800-8339-43d7-8fec-dbda9325e48b tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1469 microversion: 2.1 time: 0.188014 Jun 02 13:55:36.992919 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 113/241] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:36 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1469 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:37.382874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-f824f161-6a35-49bb-99a2-5a294537e780 req-3c9184c7-c92d-4e07-bb8b-6492f5bdc3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5490e17-83da-4dfb-a31f-60d619f614be", "name": "network-vif-deleted", "tag": "f147c0c8-1142-49a5-ab6f-3a7caee335c3"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:55:37.398583 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-f824f161-6a35-49bb-99a2-5a294537e780 req-3c9184c7-c92d-4e07-bb8b-6492f5bdc3e6 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:37.399155 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-f824f161-6a35-49bb-99a2-5a294537e780 req-3c9184c7-c92d-4e07-bb8b-6492f5bdc3e6 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:37.415271 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-f824f161-6a35-49bb-99a2-5a294537e780 req-3c9184c7-c92d-4e07-bb8b-6492f5bdc3e6 service nova] Creating event network-vif-deleted:f147c0c8-1142-49a5-ab6f-3a7caee335c3 for instance b5490e17-83da-4dfb-a31f-60d619f614be on hv-cinder-82651 Jun 02 13:55:37.428318 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-f824f161-6a35-49bb-99a2-5a294537e780 req-3c9184c7-c92d-4e07-bb8b-6492f5bdc3e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052551 Jun 02 13:55:37.429085 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 129/242] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:55:37.483195 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c146cb09-314f-449a-a150-6a8e4bde827c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:37.483854 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c146cb09-314f-449a-a150-6a8e4bde827c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:37.490544 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c146cb09-314f-449a-a150-6a8e4bde827c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:37.490984 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c146cb09-314f-449a-a150-6a8e4bde827c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:37.491782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c146cb09-314f-449a-a150-6a8e4bde827c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:37.492204 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c146cb09-314f-449a-a150-6a8e4bde827c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:37.556356 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c146cb09-314f-449a-a150-6a8e4bde827c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:37.564338 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c146cb09-314f-449a-a150-6a8e4bde827c tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1512 microversion: 2.1 time: 0.085105 Jun 02 13:55:37.574468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 114/243] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:37 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1512 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:37.692166 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-58dfa986-df6d-4e53-ac6f-5b3fe6f4f791 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:37.692944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-58dfa986-df6d-4e53-ac6f-5b3fe6f4f791 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:37.699027 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-58dfa986-df6d-4e53-ac6f-5b3fe6f4f791 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:37.699464 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-58dfa986-df6d-4e53-ac6f-5b3fe6f4f791 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:37.700482 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-58dfa986-df6d-4e53-ac6f-5b3fe6f4f791 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:37.700907 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-58dfa986-df6d-4e53-ac6f-5b3fe6f4f791 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:37.861394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-58dfa986-df6d-4e53-ac6f-5b3fe6f4f791 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:37.869396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-58dfa986-df6d-4e53-ac6f-5b3fe6f4f791 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.181991 Jun 02 13:55:37.870013 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 130/244] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:37 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:37.998727 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c33ffbd8-820b-4b54-88b0-1a49c2872eb3 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:37.999341 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c33ffbd8-820b-4b54-88b0-1a49c2872eb3 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:38.006049 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c33ffbd8-820b-4b54-88b0-1a49c2872eb3 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:38.006494 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c33ffbd8-820b-4b54-88b0-1a49c2872eb3 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:38.007346 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c33ffbd8-820b-4b54-88b0-1a49c2872eb3 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:38.007775 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c33ffbd8-820b-4b54-88b0-1a49c2872eb3 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:38.142628 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c33ffbd8-820b-4b54-88b0-1a49c2872eb3 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:38.168573 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c33ffbd8-820b-4b54-88b0-1a49c2872eb3 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1469 microversion: 2.1 time: 0.164538 Jun 02 13:55:38.168573 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 115/245] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:37 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:38.582052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7a92411b-84d9-49fa-8e04-80eb86ba9dfd tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:38.582659 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7a92411b-84d9-49fa-8e04-80eb86ba9dfd tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:38.588784 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7a92411b-84d9-49fa-8e04-80eb86ba9dfd tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:38.589217 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7a92411b-84d9-49fa-8e04-80eb86ba9dfd tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:38.589971 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7a92411b-84d9-49fa-8e04-80eb86ba9dfd tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:38.590396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7a92411b-84d9-49fa-8e04-80eb86ba9dfd tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:38.661942 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7a92411b-84d9-49fa-8e04-80eb86ba9dfd tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:38.669999 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7a92411b-84d9-49fa-8e04-80eb86ba9dfd tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1512 microversion: 2.1 time: 0.091908 Jun 02 13:55:38.670593 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 131/246] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:38 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1512 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:38.886953 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-46fe32ea-3c7c-44fa-9c89-03e914eba58f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:38.887574 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-46fe32ea-3c7c-44fa-9c89-03e914eba58f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:38.895302 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-46fe32ea-3c7c-44fa-9c89-03e914eba58f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:38.897346 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-46fe32ea-3c7c-44fa-9c89-03e914eba58f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:38.898446 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-46fe32ea-3c7c-44fa-9c89-03e914eba58f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:38.900343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-46fe32ea-3c7c-44fa-9c89-03e914eba58f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:39.177370 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-29d3dab8-ab35-45c8-96d3-0aa8d17f469e tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:39.177990 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-29d3dab8-ab35-45c8-96d3-0aa8d17f469e tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:39.180397 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-46fe32ea-3c7c-44fa-9c89-03e914eba58f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:39.184173 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-29d3dab8-ab35-45c8-96d3-0aa8d17f469e tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:39.186755 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-29d3dab8-ab35-45c8-96d3-0aa8d17f469e tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:39.188704 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-46fe32ea-3c7c-44fa-9c89-03e914eba58f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.305600 Jun 02 13:55:39.196576 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 116/247] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:38 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:39.196915 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-29d3dab8-ab35-45c8-96d3-0aa8d17f469e tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:39.196915 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-29d3dab8-ab35-45c8-96d3-0aa8d17f469e tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:39.339828 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-29d3dab8-ab35-45c8-96d3-0aa8d17f469e tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:39.348643 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-29d3dab8-ab35-45c8-96d3-0aa8d17f469e tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1469 microversion: 2.1 time: 0.175908 Jun 02 13:55:39.349138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 132/248] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:39 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:39.688487 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-87236f20-b146-4745-b8df-991fd9e2b7bc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:39.689126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-87236f20-b146-4745-b8df-991fd9e2b7bc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:39.695934 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-87236f20-b146-4745-b8df-991fd9e2b7bc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:39.696384 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-87236f20-b146-4745-b8df-991fd9e2b7bc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:39.697177 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-87236f20-b146-4745-b8df-991fd9e2b7bc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:39.697608 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-87236f20-b146-4745-b8df-991fd9e2b7bc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:39.766873 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-87236f20-b146-4745-b8df-991fd9e2b7bc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:39.777080 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-87236f20-b146-4745-b8df-991fd9e2b7bc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1512 microversion: 2.1 time: 0.092391 Jun 02 13:55:39.777853 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 117/249] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:39 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1512 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:40.206099 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-85fa624f-48f8-4403-8f4d-128095452fba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:40.209091 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-85fa624f-48f8-4403-8f4d-128095452fba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:40.213182 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-85fa624f-48f8-4403-8f4d-128095452fba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:40.213620 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-85fa624f-48f8-4403-8f4d-128095452fba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:40.214385 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-85fa624f-48f8-4403-8f4d-128095452fba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:40.214808 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-85fa624f-48f8-4403-8f4d-128095452fba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:40.367145 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fbfcba63-3bb6-471c-aded-d1d1e9332c8c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:40.368572 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-fbfcba63-3bb6-471c-aded-d1d1e9332c8c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:40.374250 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-85fa624f-48f8-4403-8f4d-128095452fba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:40.375781 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fbfcba63-3bb6-471c-aded-d1d1e9332c8c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:40.376346 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fbfcba63-3bb6-471c-aded-d1d1e9332c8c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:40.377297 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fbfcba63-3bb6-471c-aded-d1d1e9332c8c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:40.377793 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fbfcba63-3bb6-471c-aded-d1d1e9332c8c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:40.386195 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-85fa624f-48f8-4403-8f4d-128095452fba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.183436 Jun 02 13:55:40.387085 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 133/250] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:40 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:40.518718 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-fbfcba63-3bb6-471c-aded-d1d1e9332c8c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:40.526951 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-fbfcba63-3bb6-471c-aded-d1d1e9332c8c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1469 microversion: 2.1 time: 0.164952 Jun 02 13:55:40.527656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 118/251] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:40 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:40.795104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9e166aad-7ed6-419d-bee9-a2fb639be982 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:40.795666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9e166aad-7ed6-419d-bee9-a2fb639be982 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:40.802619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9e166aad-7ed6-419d-bee9-a2fb639be982 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:40.803065 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9e166aad-7ed6-419d-bee9-a2fb639be982 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:40.803812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9e166aad-7ed6-419d-bee9-a2fb639be982 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:40.804302 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9e166aad-7ed6-419d-bee9-a2fb639be982 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:40.866987 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9e166aad-7ed6-419d-bee9-a2fb639be982 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:40.875834 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9e166aad-7ed6-419d-bee9-a2fb639be982 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1512 microversion: 2.1 time: 0.084241 Jun 02 13:55:40.876433 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 134/252] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:40 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1512 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:41.403962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a4bdad0e-ea6b-4ea1-91d6-971d2efcc3e1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:41.404601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a4bdad0e-ea6b-4ea1-91d6-971d2efcc3e1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:41.411476 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a4bdad0e-ea6b-4ea1-91d6-971d2efcc3e1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:41.412169 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a4bdad0e-ea6b-4ea1-91d6-971d2efcc3e1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:41.412732 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a4bdad0e-ea6b-4ea1-91d6-971d2efcc3e1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:41.413167 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a4bdad0e-ea6b-4ea1-91d6-971d2efcc3e1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:41.546321 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-832f4a10-6171-4f3e-be2e-f6ff58db6a7a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:41.546921 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-832f4a10-6171-4f3e-be2e-f6ff58db6a7a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:41.553675 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-832f4a10-6171-4f3e-be2e-f6ff58db6a7a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:41.554339 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-832f4a10-6171-4f3e-be2e-f6ff58db6a7a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:41.555252 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-832f4a10-6171-4f3e-be2e-f6ff58db6a7a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:41.555843 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-832f4a10-6171-4f3e-be2e-f6ff58db6a7a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:41.574259 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a4bdad0e-ea6b-4ea1-91d6-971d2efcc3e1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:41.578755 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=100 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:41.582892 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a4bdad0e-ea6b-4ea1-91d6-971d2efcc3e1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.182627 Jun 02 13:55:41.583379 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 119/253] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:41 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:41.690486 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-832f4a10-6171-4f3e-be2e-f6ff58db6a7a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:41.698572 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-832f4a10-6171-4f3e-be2e-f6ff58db6a7a tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1469 microversion: 2.1 time: 0.157190 Jun 02 13:55:41.699135 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 135/254] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:41 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:41.896990 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-99e43536-c503-4d54-92dc-e1cd5868ffb0 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:41.897527 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-99e43536-c503-4d54-92dc-e1cd5868ffb0 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:41.903889 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-99e43536-c503-4d54-92dc-e1cd5868ffb0 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:41.904333 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-99e43536-c503-4d54-92dc-e1cd5868ffb0 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:41.905124 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-99e43536-c503-4d54-92dc-e1cd5868ffb0 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:41.905560 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-99e43536-c503-4d54-92dc-e1cd5868ffb0 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:41.968555 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-99e43536-c503-4d54-92dc-e1cd5868ffb0 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:41.978427 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-99e43536-c503-4d54-92dc-e1cd5868ffb0 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1512 microversion: 2.1 time: 0.085400 Jun 02 13:55:41.979022 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 120/255] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:41 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1512 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:42.599670 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-dead6ed9-26bd-42d7-9f88-85d85e333be4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:42.600286 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-dead6ed9-26bd-42d7-9f88-85d85e333be4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:42.606366 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dead6ed9-26bd-42d7-9f88-85d85e333be4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:42.606816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dead6ed9-26bd-42d7-9f88-85d85e333be4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:42.607582 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dead6ed9-26bd-42d7-9f88-85d85e333be4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:42.608011 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dead6ed9-26bd-42d7-9f88-85d85e333be4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:42.716568 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-00cab1a8-68d4-4cee-86e7-49be1fc4b4de tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:42.717110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-00cab1a8-68d4-4cee-86e7-49be1fc4b4de tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:42.724849 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00cab1a8-68d4-4cee-86e7-49be1fc4b4de tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:42.725299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00cab1a8-68d4-4cee-86e7-49be1fc4b4de tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:42.726096 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00cab1a8-68d4-4cee-86e7-49be1fc4b4de tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:42.726558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00cab1a8-68d4-4cee-86e7-49be1fc4b4de tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:42.741419 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-dead6ed9-26bd-42d7-9f88-85d85e333be4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:42.749023 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-dead6ed9-26bd-42d7-9f88-85d85e333be4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.153462 Jun 02 13:55:42.749590 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 136/256] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:42 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:42.861006 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-00cab1a8-68d4-4cee-86e7-49be1fc4b4de tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:42.870043 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-00cab1a8-68d4-4cee-86e7-49be1fc4b4de tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1469 microversion: 2.1 time: 0.157612 Jun 02 13:55:42.877183 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 121/257] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:42 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:42.995286 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c71346c2-47c9-4234-840f-02c37e77eeb1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:42.995847 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c71346c2-47c9-4234-840f-02c37e77eeb1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:43.002010 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c71346c2-47c9-4234-840f-02c37e77eeb1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:43.002449 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c71346c2-47c9-4234-840f-02c37e77eeb1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:43.003203 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c71346c2-47c9-4234-840f-02c37e77eeb1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:43.003686 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c71346c2-47c9-4234-840f-02c37e77eeb1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:43.070431 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c71346c2-47c9-4234-840f-02c37e77eeb1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:43.078926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c71346c2-47c9-4234-840f-02c37e77eeb1 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1345 microversion: 2.1 time: 0.087483 Jun 02 13:55:43.079506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 137/258] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:42 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:43.766696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-29874ac2-8bb4-43ad-9faa-90f33598523f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:43.767385 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-29874ac2-8bb4-43ad-9faa-90f33598523f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:43.774522 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-29874ac2-8bb4-43ad-9faa-90f33598523f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:43.774969 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-29874ac2-8bb4-43ad-9faa-90f33598523f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:43.775769 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-29874ac2-8bb4-43ad-9faa-90f33598523f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:43.776203 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-29874ac2-8bb4-43ad-9faa-90f33598523f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:43.888104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7c8513a6-8017-4857-bd62-4fcda14c12e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:43.889020 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7c8513a6-8017-4857-bd62-4fcda14c12e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:43.897641 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7c8513a6-8017-4857-bd62-4fcda14c12e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:43.898078 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7c8513a6-8017-4857-bd62-4fcda14c12e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:43.899391 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7c8513a6-8017-4857-bd62-4fcda14c12e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:43.899537 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7c8513a6-8017-4857-bd62-4fcda14c12e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:43.912270 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-29874ac2-8bb4-43ad-9faa-90f33598523f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:43.919802 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-29874ac2-8bb4-43ad-9faa-90f33598523f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.157085 Jun 02 13:55:43.920378 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 122/259] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:43 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:44.034041 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7c8513a6-8017-4857-bd62-4fcda14c12e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:44.041702 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7c8513a6-8017-4857-bd62-4fcda14c12e1 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1469 microversion: 2.1 time: 0.158470 Jun 02 13:55:44.042289 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 138/260] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:43 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:44.095111 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2bb09ec7-8201-4306-bce0-47fa12589b9a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:44.095647 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-2bb09ec7-8201-4306-bce0-47fa12589b9a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:44.101871 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2bb09ec7-8201-4306-bce0-47fa12589b9a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:44.102319 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2bb09ec7-8201-4306-bce0-47fa12589b9a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:44.103076 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2bb09ec7-8201-4306-bce0-47fa12589b9a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:44.103504 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2bb09ec7-8201-4306-bce0-47fa12589b9a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:44.170534 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2bb09ec7-8201-4306-bce0-47fa12589b9a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:44.181896 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2bb09ec7-8201-4306-bce0-47fa12589b9a tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1345 microversion: 2.1 time: 0.087800 Jun 02 13:55:44.183575 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 123/261] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:44 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:44.939147 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-cebb3fdb-5b58-4cba-813f-f9db24efa6bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:44.939147 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-cebb3fdb-5b58-4cba-813f-f9db24efa6bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:44.946029 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cebb3fdb-5b58-4cba-813f-f9db24efa6bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:44.947068 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cebb3fdb-5b58-4cba-813f-f9db24efa6bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:44.948375 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cebb3fdb-5b58-4cba-813f-f9db24efa6bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:44.948844 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cebb3fdb-5b58-4cba-813f-f9db24efa6bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:45.060111 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fb659e28-9db1-4dac-9579-1a8747e2b5f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:45.060889 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-fb659e28-9db1-4dac-9579-1a8747e2b5f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:45.072032 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fb659e28-9db1-4dac-9579-1a8747e2b5f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:45.072506 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fb659e28-9db1-4dac-9579-1a8747e2b5f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:45.073478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fb659e28-9db1-4dac-9579-1a8747e2b5f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:45.074066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fb659e28-9db1-4dac-9579-1a8747e2b5f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:45.103374 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-cebb3fdb-5b58-4cba-813f-f9db24efa6bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:45.114679 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-cebb3fdb-5b58-4cba-813f-f9db24efa6bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.181124 Jun 02 13:55:45.115092 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 139/262] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:44 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:45.208624 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-19b8b997-4417-40c3-b91e-d7f399c52244 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:45.211982 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-19b8b997-4417-40c3-b91e-d7f399c52244 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:45.227053 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-19b8b997-4417-40c3-b91e-d7f399c52244 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:45.227818 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-19b8b997-4417-40c3-b91e-d7f399c52244 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:45.228727 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-19b8b997-4417-40c3-b91e-d7f399c52244 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:45.229405 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-19b8b997-4417-40c3-b91e-d7f399c52244 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:45.260356 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-fb659e28-9db1-4dac-9579-1a8747e2b5f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:45.269257 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-fb659e28-9db1-4dac-9579-1a8747e2b5f8 tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1427 microversion: 2.1 time: 0.213124 Jun 02 13:55:45.270009 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 124/263] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:45 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1427 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:45.275348 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-3910b721-533a-4f46-84f1-8614f94df552 req-b2779666-1f86-4f8c-96ec-c828f20fdf4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd39a90-54ba-413c-a63f-54c1e26b7c48", "name": "network-vif-deleted", "tag": "78656f18-3d14-4ddc-adde-5ec85a2d24aa"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:55:45.297247 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-3910b721-533a-4f46-84f1-8614f94df552 req-b2779666-1f86-4f8c-96ec-c828f20fdf4f service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:45.297247 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-3910b721-533a-4f46-84f1-8614f94df552 req-b2779666-1f86-4f8c-96ec-c828f20fdf4f service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:45.307204 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-3910b721-533a-4f46-84f1-8614f94df552 req-b2779666-1f86-4f8c-96ec-c828f20fdf4f service nova] Creating event network-vif-deleted:78656f18-3d14-4ddc-adde-5ec85a2d24aa for instance fdd39a90-54ba-413c-a63f-54c1e26b7c48 on hv-cinder-82651 Jun 02 13:55:45.308695 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-19b8b997-4417-40c3-b91e-d7f399c52244 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:45.312262 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-3910b721-533a-4f46-84f1-8614f94df552 req-b2779666-1f86-4f8c-96ec-c828f20fdf4f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040744 Jun 02 13:55:45.313414 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 125/264] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:55:45.329171 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-19b8b997-4417-40c3-b91e-d7f399c52244 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1345 microversion: 2.1 time: 0.121762 Jun 02 13:55:45.329171 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 140/265] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:45 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:46.132434 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2499888f-92ce-4279-a188-1209d99f9c4d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:46.133224 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-2499888f-92ce-4279-a188-1209d99f9c4d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:46.140365 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2499888f-92ce-4279-a188-1209d99f9c4d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:46.140848 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2499888f-92ce-4279-a188-1209d99f9c4d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:46.141696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2499888f-92ce-4279-a188-1209d99f9c4d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:46.142130 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2499888f-92ce-4279-a188-1209d99f9c4d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:46.287360 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-145e67bf-582d-4b03-a280-8b8e04b4e23c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:46.288112 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-145e67bf-582d-4b03-a280-8b8e04b4e23c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:46.295891 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-145e67bf-582d-4b03-a280-8b8e04b4e23c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:46.296354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-145e67bf-582d-4b03-a280-8b8e04b4e23c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:46.297138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-145e67bf-582d-4b03-a280-8b8e04b4e23c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:46.297567 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-145e67bf-582d-4b03-a280-8b8e04b4e23c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:46.309097 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2499888f-92ce-4279-a188-1209d99f9c4d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:46.317577 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2499888f-92ce-4279-a188-1209d99f9c4d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.190002 Jun 02 13:55:46.318471 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 126/266] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:46 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:46.337796 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-145e67bf-582d-4b03-a280-8b8e04b4e23c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:46.338490 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-145e67bf-582d-4b03-a280-8b8e04b4e23c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:46.338943 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-145e67bf-582d-4b03-a280-8b8e04b4e23c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lazy-loading 'fault' on Instance uuid fdd39a90-54ba-413c-a63f-54c1e26b7c48 {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:55:46.344881 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:46.352114 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-89227ecd-17ca-4de5-b2fa-098f4ff565c7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:46.353226 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-89227ecd-17ca-4de5-b2fa-098f4ff565c7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:46.360664 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-89227ecd-17ca-4de5-b2fa-098f4ff565c7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:46.361125 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-89227ecd-17ca-4de5-b2fa-098f4ff565c7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:46.362428 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-89227ecd-17ca-4de5-b2fa-098f4ff565c7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:46.363599 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-89227ecd-17ca-4de5-b2fa-098f4ff565c7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:46.396275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-145e67bf-582d-4b03-a280-8b8e04b4e23c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65aafb8e5b564f6894cb49f2de27d4d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6b4382cb104dde8ef340d6cf4f3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:46.403634 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-89227ecd-17ca-4de5-b2fa-098f4ff565c7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:46.404097 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-89227ecd-17ca-4de5-b2fa-098f4ff565c7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:46.404678 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-89227ecd-17ca-4de5-b2fa-098f4ff565c7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lazy-loading 'fault' on Instance uuid b5490e17-83da-4dfb-a31f-60d619f614be {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:55:46.414048 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-145e67bf-582d-4b03-a280-8b8e04b4e23c tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 200 len: 1304 microversion: 2.1 time: 0.130320 Jun 02 13:55:46.415134 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 141/267] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:46 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:46.458361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-89227ecd-17ca-4de5-b2fa-098f4ff565c7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726a1e35b0ba437db464fbe108b0cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e9456d87f7446593f2e09b71de4c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:46.467057 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-89227ecd-17ca-4de5-b2fa-098f4ff565c7 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 200 len: 1350 microversion: 2.1 time: 0.126866 Jun 02 13:55:46.467917 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 127/268] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:46 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 1350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:47.335293 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-820e92b1-5038-498e-9be0-6423d74390eb tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:47.335904 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-820e92b1-5038-498e-9be0-6423d74390eb tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:47.342569 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-820e92b1-5038-498e-9be0-6423d74390eb tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:47.343015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-820e92b1-5038-498e-9be0-6423d74390eb tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:47.343773 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-820e92b1-5038-498e-9be0-6423d74390eb tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:47.344203 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-820e92b1-5038-498e-9be0-6423d74390eb tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:47.433410 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-eb193fe7-59f1-4ee0-a151-b655eb6da8eb tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:47.434567 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-eb193fe7-59f1-4ee0-a151-b655eb6da8eb tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] [instance: fdd39a90-54ba-413c-a63f-54c1e26b7c48] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:47.442735 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-eb193fe7-59f1-4ee0-a151-b655eb6da8eb tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:47.443272 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-eb193fe7-59f1-4ee0-a151-b655eb6da8eb tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:47.444378 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-eb193fe7-59f1-4ee0-a151-b655eb6da8eb tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:47.445057 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-eb193fe7-59f1-4ee0-a151-b655eb6da8eb tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:47.460825 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-eb193fe7-59f1-4ee0-a151-b655eb6da8eb tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] HTTP exception thrown: Instance fdd39a90-54ba-413c-a63f-54c1e26b7c48 could not be found. Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-eb193fe7-59f1-4ee0-a151-b655eb6da8eb tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Request method failure captured: Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 HTTP/1.1 Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMErghjJCcn1lvSPocap_W78xtPcscmX0cQ3jtv5UVvAm3GwwP7TiOPH10a99O4lhiglrXNRVczs8AVE3GXIoY1a1Ldvh59eO8JIykkidgcJUnyupkkS7jHvPFxcpW2FVm76fbrCT83qYkwX84cbvogqoFWVExWW4_O8hwdXd0kU7d4 Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 0d6b4382cb104dde8ef340d6cf4f3037 Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-VolumesNegativeTest-2062500728 Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 13:55:47.465748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 13:55:47.467181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d6b4382cb104dde8ef340d6cf4f3037"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d6b4382cb104dde8ef340d6cf4f3037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d6b4382cb104dde8ef340d6cf4f3037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d6b4382cb104dde8ef340d6cf4f3037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:55:47.467181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-VolumesNegativeTest-2062500728 Jun 02 13:55:47.467181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 0d6b4382cb104dde8ef340d6cf4f3037 Jun 02 13:55:47.467181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-VolumesNegativeTest-2062500728 Jun 02 13:55:47.467181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-VolumesNegativeTest-2062500728-project Jun 02 13:55:47.467181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 13:55:47.467181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 13:55:47.467181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 65aafb8e5b564f6894cb49f2de27d4d0 Jun 02 13:55:47.467181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-VolumesNegativeTest-2062500728-project Jun 02 13:55:47.467181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 13:55:47.467181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance fdd39a90-54ba-413c-a63f-54c1e26b7c48 could not be found. Jun 02 13:55:47.467181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': 'fdd39a90-54ba-413c-a63f-54c1e26b7c48'} Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd39a90-54ba-413c-a63f-54c1e26b7c48 could not be found. Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:55:47.467847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd39a90-54ba-413c-a63f-54c1e26b7c48 could not be found. Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd39a90-54ba-413c-a63f-54c1e26b7c48 could not be found. Jun 02 13:55:47.469294 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.471350 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-eb193fe7-59f1-4ee0-a151-b655eb6da8eb tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] Returning 404 to user: Instance fdd39a90-54ba-413c-a63f-54c1e26b7c48 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:55:47.472455 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-eb193fe7-59f1-4ee0-a151-b655eb6da8eb tempest-VolumesNegativeTest-2062500728 tempest-VolumesNegativeTest-2062500728-project] 10.222.0.33 "GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48" status: 404 len: 111 microversion: 2.1 time: 0.043038 Jun 02 13:55:47.473586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 128/269] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:47 2022] GET /compute/v2.1/servers/fdd39a90-54ba-413c-a63f-54c1e26b7c48 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:55:47.496827 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-820e92b1-5038-498e-9be0-6423d74390eb tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:47.506227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-820e92b1-5038-498e-9be0-6423d74390eb tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.175744 Jun 02 13:55:47.515884 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 142/270] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:47 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:47.516255 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b7bd3c96-94d0-422c-978b-6e7fb429e4fa tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:47.516255 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b7bd3c96-94d0-422c-978b-6e7fb429e4fa tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:47.516255 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7bd3c96-94d0-422c-978b-6e7fb429e4fa tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:47.516255 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7bd3c96-94d0-422c-978b-6e7fb429e4fa tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:47.516601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7bd3c96-94d0-422c-978b-6e7fb429e4fa tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:47.516887 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7bd3c96-94d0-422c-978b-6e7fb429e4fa tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:47.532537 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-b7bd3c96-94d0-422c-978b-6e7fb429e4fa tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] HTTP exception thrown: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b7bd3c96-94d0-422c-978b-6e7fb429e4fa tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Request method failure captured: Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be HTTP/1.1 Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMD0hGeAdJRb_GjblCsQjtp_55G7q9uggaYY8TLjFTJbpAzg9M3k5q_relpAtCC3g9NSOqhH4K-c5BRsiE629fZjlLMa47ys5uU9IxOOtSYwZMYUyEdwiy2s5aPNunR_deg75fYqnENEwtyb6XiN8CIqrQ19o2wJeQcmjMLP19QTQF4 Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 50e9456d87f7446593f2e09b71de4c61 Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-DeleteServersTestJSON-948013501 Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 13:55:47.534056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 13:55:47.535689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:55:47.535689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-DeleteServersTestJSON-948013501 Jun 02 13:55:47.535689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 50e9456d87f7446593f2e09b71de4c61 Jun 02 13:55:47.535689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-DeleteServersTestJSON-948013501 Jun 02 13:55:47.535689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-DeleteServersTestJSON-948013501-project Jun 02 13:55:47.535689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 13:55:47.535689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 13:55:47.535689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 726a1e35b0ba437db464fbe108b0cd77 Jun 02 13:55:47.535689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-DeleteServersTestJSON-948013501-project Jun 02 13:55:47.535689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 13:55:47.535689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:47.535689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': 'b5490e17-83da-4dfb-a31f-60d619f614be'} Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:55:47.536529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:47.537656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.538826 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b7bd3c96-94d0-422c-978b-6e7fb429e4fa tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Returning 404 to user: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:55:47.538826 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b7bd3c96-94d0-422c-978b-6e7fb429e4fa tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 404 len: 111 microversion: 2.1 time: 0.032923 Jun 02 13:55:47.538826 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 129/271] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:47 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:55:47.653331 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b42cbf54-b0ae-4101-ba99-747f94ce6ccc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:47.654528 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b42cbf54-b0ae-4101-ba99-747f94ce6ccc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:47.661101 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b42cbf54-b0ae-4101-ba99-747f94ce6ccc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:47.662843 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b42cbf54-b0ae-4101-ba99-747f94ce6ccc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:47.663792 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b42cbf54-b0ae-4101-ba99-747f94ce6ccc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:47.664238 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b42cbf54-b0ae-4101-ba99-747f94ce6ccc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:47.678789 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-b42cbf54-b0ae-4101-ba99-747f94ce6ccc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] HTTP exception thrown: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b42cbf54-b0ae-4101-ba99-747f94ce6ccc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Request method failure captured: Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be/os-volume_attachments HTTP/1.1 Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMD0hGeAdJRb_GjblCsQjtp_55G7q9uggaYY8TLjFTJbpAzg9M3k5q_relpAtCC3g9NSOqhH4K-c5BRsiE629fZjlLMa47ys5uU9IxOOtSYwZMYUyEdwiy2s5aPNunR_deg75fYqnENEwtyb6XiN8CIqrQ19o2wJeQcmjMLP19QTQF4 Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 50e9456d87f7446593f2e09b71de4c61 Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-DeleteServersTestJSON-948013501 Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 13:55:47.683188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 13:55:47.684854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:55:47.684854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-DeleteServersTestJSON-948013501 Jun 02 13:55:47.684854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 50e9456d87f7446593f2e09b71de4c61 Jun 02 13:55:47.684854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-DeleteServersTestJSON-948013501 Jun 02 13:55:47.684854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-DeleteServersTestJSON-948013501-project Jun 02 13:55:47.684854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 13:55:47.684854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 13:55:47.684854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 726a1e35b0ba437db464fbe108b0cd77 Jun 02 13:55:47.684854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-DeleteServersTestJSON-948013501-project Jun 02 13:55:47.684854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 13:55:47.684854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:47.684854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'server_id': 'b5490e17-83da-4dfb-a31f-60d619f614be'} Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:55:47.685830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:47.687290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:55:47.688717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b42cbf54-b0ae-4101-ba99-747f94ce6ccc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Returning 404 to user: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:55:47.688717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b42cbf54-b0ae-4101-ba99-747f94ce6ccc tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035206 Jun 02 13:55:47.688717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 143/272] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 13:55:47 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:55:48.523781 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b8262e12-9630-4f42-9aa6-bdf76a0c63e2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:48.525162 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b8262e12-9630-4f42-9aa6-bdf76a0c63e2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:48.532360 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8262e12-9630-4f42-9aa6-bdf76a0c63e2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:48.532816 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8262e12-9630-4f42-9aa6-bdf76a0c63e2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:48.533770 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8262e12-9630-4f42-9aa6-bdf76a0c63e2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:48.534278 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8262e12-9630-4f42-9aa6-bdf76a0c63e2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:48.677003 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b8262e12-9630-4f42-9aa6-bdf76a0c63e2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:48.684201 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b8262e12-9630-4f42-9aa6-bdf76a0c63e2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.164932 Jun 02 13:55:48.684876 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 130/273] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:48 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:49.702772 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-cda762bd-402e-4977-86b1-db6db723cbb6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:49.704131 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-cda762bd-402e-4977-86b1-db6db723cbb6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:49.716822 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cda762bd-402e-4977-86b1-db6db723cbb6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:49.717563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cda762bd-402e-4977-86b1-db6db723cbb6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:49.718831 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cda762bd-402e-4977-86b1-db6db723cbb6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:49.719846 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cda762bd-402e-4977-86b1-db6db723cbb6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:49.899688 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-cda762bd-402e-4977-86b1-db6db723cbb6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:49.910754 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-cda762bd-402e-4977-86b1-db6db723cbb6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.211791 Jun 02 13:55:49.911764 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 144/274] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:49 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:50.176312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3f47f410-811b-42fb-a021-c7b0345d5a1b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:50.176909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3f47f410-811b-42fb-a021-c7b0345d5a1b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:50.183583 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:50.185756 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3f47f410-811b-42fb-a021-c7b0345d5a1b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:50.187382 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3f47f410-811b-42fb-a021-c7b0345d5a1b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:50.189405 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3f47f410-811b-42fb-a021-c7b0345d5a1b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:50.192281 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3f47f410-811b-42fb-a021-c7b0345d5a1b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:50.221380 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-3f47f410-811b-42fb-a021-c7b0345d5a1b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] HTTP exception thrown: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3f47f410-811b-42fb-a021-c7b0345d5a1b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Request method failure captured: Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: DELETE /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be HTTP/1.1 Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMD0hGeAdJRb_GjblCsQjtp_55G7q9uggaYY8TLjFTJbpAzg9M3k5q_relpAtCC3g9NSOqhH4K-c5BRsiE629fZjlLMa47ys5uU9IxOOtSYwZMYUyEdwiy2s5aPNunR_deg75fYqnENEwtyb6XiN8CIqrQ19o2wJeQcmjMLP19QTQF4 Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 50e9456d87f7446593f2e09b71de4c61 Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-DeleteServersTestJSON-948013501 Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 13:55:50.225061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 13:55:50.226311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:55:50.226311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-DeleteServersTestJSON-948013501 Jun 02 13:55:50.226311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 50e9456d87f7446593f2e09b71de4c61 Jun 02 13:55:50.226311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-DeleteServersTestJSON-948013501 Jun 02 13:55:50.226311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-DeleteServersTestJSON-948013501-project Jun 02 13:55:50.226311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 13:55:50.226311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 13:55:50.226311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 726a1e35b0ba437db464fbe108b0cd77 Jun 02 13:55:50.226311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-DeleteServersTestJSON-948013501-project Jun 02 13:55:50.226311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 13:55:50.226311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:50.226311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': 'b5490e17-83da-4dfb-a31f-60d619f614be'} Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:55:50.227090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:50.228154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 13:55:50.232921 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3f47f410-811b-42fb-a021-c7b0345d5a1b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Returning 404 to user: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:55:50.232921 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3f47f410-811b-42fb-a021-c7b0345d5a1b tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 404 len: 111 microversion: 2.1 time: 0.054826 Jun 02 13:55:50.232921 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 131/275] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 13:55:50 2022] DELETE /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:55:50.237597 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-665bbd58-b491-4fd1-8688-7a59d09c1a59 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:50.238370 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-665bbd58-b491-4fd1-8688-7a59d09c1a59 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] [instance: b5490e17-83da-4dfb-a31f-60d619f614be] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:50.254528 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-665bbd58-b491-4fd1-8688-7a59d09c1a59 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:50.258470 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-665bbd58-b491-4fd1-8688-7a59d09c1a59 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:50.259391 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-665bbd58-b491-4fd1-8688-7a59d09c1a59 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:50.267379 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-665bbd58-b491-4fd1-8688-7a59d09c1a59 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:50.311424 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-665bbd58-b491-4fd1-8688-7a59d09c1a59 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] HTTP exception thrown: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-665bbd58-b491-4fd1-8688-7a59d09c1a59 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Request method failure captured: Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be HTTP/1.1 Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMD0hGeAdJRb_GjblCsQjtp_55G7q9uggaYY8TLjFTJbpAzg9M3k5q_relpAtCC3g9NSOqhH4K-c5BRsiE629fZjlLMa47ys5uU9IxOOtSYwZMYUyEdwiy2s5aPNunR_deg75fYqnENEwtyb6XiN8CIqrQ19o2wJeQcmjMLP19QTQF4 Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 50e9456d87f7446593f2e09b71de4c61 Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-DeleteServersTestJSON-948013501 Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 13:55:50.317330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 13:55:50.318874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/50e9456d87f7446593f2e09b71de4c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:55:50.318874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-DeleteServersTestJSON-948013501 Jun 02 13:55:50.318874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 50e9456d87f7446593f2e09b71de4c61 Jun 02 13:55:50.318874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-DeleteServersTestJSON-948013501 Jun 02 13:55:50.318874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-DeleteServersTestJSON-948013501-project Jun 02 13:55:50.318874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 13:55:50.318874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 13:55:50.318874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 726a1e35b0ba437db464fbe108b0cd77 Jun 02 13:55:50.318874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-DeleteServersTestJSON-948013501-project Jun 02 13:55:50.318874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 13:55:50.318874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:50.318874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': 'b5490e17-83da-4dfb-a31f-60d619f614be'} Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:55:50.319666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. Jun 02 13:55:50.320744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:55:50.321700 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-665bbd58-b491-4fd1-8688-7a59d09c1a59 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] Returning 404 to user: Instance b5490e17-83da-4dfb-a31f-60d619f614be could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:55:50.321700 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-665bbd58-b491-4fd1-8688-7a59d09c1a59 tempest-DeleteServersTestJSON-948013501 tempest-DeleteServersTestJSON-948013501-project] 10.222.0.33 "GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be" status: 404 len: 111 microversion: 2.1 time: 0.086493 Jun 02 13:55:50.321700 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 145/276] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:50 2022] GET /compute/v2.1/servers/b5490e17-83da-4dfb-a31f-60d619f614be => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:55:50.929299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a24e0f48-308f-46af-970a-0761600d4f1a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:50.930491 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a24e0f48-308f-46af-970a-0761600d4f1a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:50.940612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a24e0f48-308f-46af-970a-0761600d4f1a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:50.941513 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a24e0f48-308f-46af-970a-0761600d4f1a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:50.942797 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a24e0f48-308f-46af-970a-0761600d4f1a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:50.943376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a24e0f48-308f-46af-970a-0761600d4f1a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:51.288134 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a24e0f48-308f-46af-970a-0761600d4f1a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:51.297757 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a24e0f48-308f-46af-970a-0761600d4f1a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.374350 Jun 02 13:55:51.298646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 132/277] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:50 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:52.314902 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-bb609fb1-396c-4659-beff-fe459ac148bf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:52.316496 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-bb609fb1-396c-4659-beff-fe459ac148bf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:52.334841 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bb609fb1-396c-4659-beff-fe459ac148bf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:52.345317 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bb609fb1-396c-4659-beff-fe459ac148bf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:52.348858 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bb609fb1-396c-4659-beff-fe459ac148bf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:52.354396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bb609fb1-396c-4659-beff-fe459ac148bf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:52.691600 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-bb609fb1-396c-4659-beff-fe459ac148bf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:52.703638 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-bb609fb1-396c-4659-beff-fe459ac148bf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1521 microversion: 2.1 time: 0.392770 Jun 02 13:55:52.704510 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 146/278] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:52 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:53.720995 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-44aaf01c-0818-4c79-89e7-6c0128026868 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:53.722285 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-44aaf01c-0818-4c79-89e7-6c0128026868 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:53.729264 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-44aaf01c-0818-4c79-89e7-6c0128026868 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:53.735446 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-44aaf01c-0818-4c79-89e7-6c0128026868 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:53.735446 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-44aaf01c-0818-4c79-89e7-6c0128026868 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:53.735446 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-44aaf01c-0818-4c79-89e7-6c0128026868 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:53.898336 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-44aaf01c-0818-4c79-89e7-6c0128026868 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:53.906136 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-44aaf01c-0818-4c79-89e7-6c0128026868 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1501 microversion: 2.1 time: 0.189400 Jun 02 13:55:53.909340 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 133/279] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:53 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1501 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:53.922544 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9d872fb9-6326-4967-a30b-c68fde4b5cc0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:53.923161 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9d872fb9-6326-4967-a30b-c68fde4b5cc0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:53.929872 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d872fb9-6326-4967-a30b-c68fde4b5cc0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:53.930394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d872fb9-6326-4967-a30b-c68fde4b5cc0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:53.931087 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d872fb9-6326-4967-a30b-c68fde4b5cc0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:53.931522 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d872fb9-6326-4967-a30b-c68fde4b5cc0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:54.072301 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9d872fb9-6326-4967-a30b-c68fde4b5cc0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:54.090163 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9d872fb9-6326-4967-a30b-c68fde4b5cc0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1515 microversion: 2.1 time: 0.171463 Jun 02 13:55:54.090771 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 147/280] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:53 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:55:57.361439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e1345517-29cc-43b5-a5ad-1cc42e948bb8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:55:57.362410 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e1345517-29cc-43b5-a5ad-1cc42e948bb8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:57.375173 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e1345517-29cc-43b5-a5ad-1cc42e948bb8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:57.375763 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e1345517-29cc-43b5-a5ad-1cc42e948bb8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:57.377371 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e1345517-29cc-43b5-a5ad-1cc42e948bb8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:57.378230 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e1345517-29cc-43b5-a5ad-1cc42e948bb8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:57.412690 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-e1345517-29cc-43b5-a5ad-1cc42e948bb8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lazy-loading 'flavor' on Instance uuid 478fcfd0-657e-41c0-b9f2-38f449129a3b {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:55:57.929037 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e1345517-29cc-43b5-a5ad-1cc42e948bb8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "POST /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b/action" status: 200 len: 32 microversion: 2.1 time: 0.571486 Jun 02 13:55:57.930819 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 134/281] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 2 13:55:57 2022] POST /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b/action => generated 32 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:55:57.939758 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f57aedd9-37f0-4486-ae74-290aca752df4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:57.941748 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f57aedd9-37f0-4486-ae74-290aca752df4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:57.953362 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f57aedd9-37f0-4486-ae74-290aca752df4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:57.953362 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f57aedd9-37f0-4486-ae74-290aca752df4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:57.953362 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f57aedd9-37f0-4486-ae74-290aca752df4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:57.953362 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f57aedd9-37f0-4486-ae74-290aca752df4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:58.367624 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f57aedd9-37f0-4486-ae74-290aca752df4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:58.392103 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f57aedd9-37f0-4486-ae74-290aca752df4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.442069 Jun 02 13:55:58.402402 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 148/282] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:57 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:55:59.414033 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c1d3513e-deec-4cee-abf7-19c636ce36d6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:55:59.417576 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c1d3513e-deec-4cee-abf7-19c636ce36d6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:55:59.439247 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c1d3513e-deec-4cee-abf7-19c636ce36d6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:59.440292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c1d3513e-deec-4cee-abf7-19c636ce36d6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:59.444007 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c1d3513e-deec-4cee-abf7-19c636ce36d6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:55:59.444533 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c1d3513e-deec-4cee-abf7-19c636ce36d6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:55:59.755223 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c1d3513e-deec-4cee-abf7-19c636ce36d6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:55:59.765317 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c1d3513e-deec-4cee-abf7-19c636ce36d6 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.358752 Jun 02 13:55:59.765896 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 135/283] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:55:59 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:00.783323 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c8c6b1cd-0956-4c45-bff6-fac79ae0fafe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:00.784580 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c8c6b1cd-0956-4c45-bff6-fac79ae0fafe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:00.793450 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:00.799194 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c8c6b1cd-0956-4c45-bff6-fac79ae0fafe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:00.799869 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c8c6b1cd-0956-4c45-bff6-fac79ae0fafe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:00.803139 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c8c6b1cd-0956-4c45-bff6-fac79ae0fafe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:00.803610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c8c6b1cd-0956-4c45-bff6-fac79ae0fafe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:01.255215 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c8c6b1cd-0956-4c45-bff6-fac79ae0fafe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:01.273364 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c8c6b1cd-0956-4c45-bff6-fac79ae0fafe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.493821 Jun 02 13:56:01.283044 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 149/284] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:00 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:02.299172 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e8700a43-c03d-402d-8187-bce3381b51ad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:02.299887 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e8700a43-c03d-402d-8187-bce3381b51ad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:02.307536 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e8700a43-c03d-402d-8187-bce3381b51ad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:02.307944 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e8700a43-c03d-402d-8187-bce3381b51ad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:02.308823 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e8700a43-c03d-402d-8187-bce3381b51ad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:02.315341 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e8700a43-c03d-402d-8187-bce3381b51ad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:02.640950 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e8700a43-c03d-402d-8187-bce3381b51ad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:02.645342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:02.650249 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e8700a43-c03d-402d-8187-bce3381b51ad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.363096 Jun 02 13:56:02.653170 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 136/285] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:02 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:03.189897 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-aac20a15-02a4-40b3-aed9-a013468dcc60 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Action: 'create', calling method: .version_select at 0x7fb720163f70>, body: {"keypair": {"name": "tempest-keypair-176488862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4EcONY/EgHA2SoB8lrqxTP/X3U4vWL0s3VGrsTdGS1+CrAw2oxuXD7adxsmAR4L29H3zETBCbhTX5D6eh2tLci3rl7hYapO/ovZciXECSRqq3BndlX8auv0Y/S6013oA=="}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:56:03.225218 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-aac20a15-02a4-40b3-aed9-a013468dcc60 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for project 8f72940f7df74b898595c0ed9c654502. Resources: {'key_pairs'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:56:03.231340 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-aac20a15-02a4-40b3-aed9-a013468dcc60 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for user b8d05eeb8ac146969b99d33084f1664c and project 8f72940f7df74b898595c0ed9c654502. Resources: {'key_pairs'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:56:03.406343 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-aac20a15-02a4-40b3-aed9-a013468dcc60 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.478545 Jun 02 13:56:03.406960 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 150/286] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 2 13:56:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:56:03.671526 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-689b8a56-c62c-4338-907f-a367c8cbf171 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:03.672087 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-689b8a56-c62c-4338-907f-a367c8cbf171 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:03.680249 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-689b8a56-c62c-4338-907f-a367c8cbf171 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:03.680727 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-689b8a56-c62c-4338-907f-a367c8cbf171 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:03.681644 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-689b8a56-c62c-4338-907f-a367c8cbf171 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:03.682139 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-689b8a56-c62c-4338-907f-a367c8cbf171 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:03.841474 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-689b8a56-c62c-4338-907f-a367c8cbf171 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:03.849703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-689b8a56-c62c-4338-907f-a367c8cbf171 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.183333 Jun 02 13:56:03.850361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 137/287] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:03 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:04.869225 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b5f87924-3eb9-4cfa-ad2b-5ec7d1bd1094 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:04.870534 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b5f87924-3eb9-4cfa-ad2b-5ec7d1bd1094 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:04.884272 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b5f87924-3eb9-4cfa-ad2b-5ec7d1bd1094 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:04.884770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b5f87924-3eb9-4cfa-ad2b-5ec7d1bd1094 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:04.885759 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b5f87924-3eb9-4cfa-ad2b-5ec7d1bd1094 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:04.886198 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b5f87924-3eb9-4cfa-ad2b-5ec7d1bd1094 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:05.170817 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b5f87924-3eb9-4cfa-ad2b-5ec7d1bd1094 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:05.182450 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b5f87924-3eb9-4cfa-ad2b-5ec7d1bd1094 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.317145 Jun 02 13:56:05.192065 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 151/288] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:04 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:06.199989 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-414c92c3-1e97-4952-ac42-b546d159d3fe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:06.200788 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-414c92c3-1e97-4952-ac42-b546d159d3fe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:06.215076 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-414c92c3-1e97-4952-ac42-b546d159d3fe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:06.215348 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-414c92c3-1e97-4952-ac42-b546d159d3fe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:06.219465 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-414c92c3-1e97-4952-ac42-b546d159d3fe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:06.220454 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-414c92c3-1e97-4952-ac42-b546d159d3fe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:06.527117 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-414c92c3-1e97-4952-ac42-b546d159d3fe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:06.539827 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-414c92c3-1e97-4952-ac42-b546d159d3fe tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.344096 Jun 02 13:56:06.540532 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 138/289] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:06 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:07.558184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-257b3134-38bf-4d54-b367-7bd32f7a2f19 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:07.558862 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-257b3134-38bf-4d54-b367-7bd32f7a2f19 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:07.581789 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-257b3134-38bf-4d54-b367-7bd32f7a2f19 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:07.581789 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-257b3134-38bf-4d54-b367-7bd32f7a2f19 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:07.581789 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-257b3134-38bf-4d54-b367-7bd32f7a2f19 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:07.581789 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-257b3134-38bf-4d54-b367-7bd32f7a2f19 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:08.218914 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-257b3134-38bf-4d54-b367-7bd32f7a2f19 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:08.233496 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-257b3134-38bf-4d54-b367-7bd32f7a2f19 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.680358 Jun 02 13:56:08.234365 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 152/290] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:07 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:09.254249 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4fe08a28-44d3-4ca7-a0ce-3ede7bfaaf7a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:09.255501 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4fe08a28-44d3-4ca7-a0ce-3ede7bfaaf7a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:09.273261 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4fe08a28-44d3-4ca7-a0ce-3ede7bfaaf7a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:09.273944 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4fe08a28-44d3-4ca7-a0ce-3ede7bfaaf7a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:09.275406 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4fe08a28-44d3-4ca7-a0ce-3ede7bfaaf7a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:09.276991 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4fe08a28-44d3-4ca7-a0ce-3ede7bfaaf7a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:09.363752 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-260545245", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14cc21cb-4d69-474d-9628-4e979c4e6581"}], "security_groups": [{"name": "tempest-securitygroup--628590673"}], "key_name": "tempest-keypair-176488862", "user_data": "}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:56:09.581103 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4fe08a28-44d3-4ca7-a0ce-3ede7bfaaf7a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:09.593960 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4fe08a28-44d3-4ca7-a0ce-3ede7bfaaf7a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.346594 Jun 02 13:56:09.604620 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 139/291] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:09 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:09.632532 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.network.neutron [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] validate_networks() for [('14cc21cb-4d69-474d-9628-4e979c4e6581', None, None, None, None, None)] {{(pid=118316) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:56:10.619991 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-88edc653-2e42-4639-9fe7-99210c925388 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:10.625636 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-88edc653-2e42-4639-9fe7-99210c925388 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:10.631998 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-88edc653-2e42-4639-9fe7-99210c925388 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:10.632478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-88edc653-2e42-4639-9fe7-99210c925388 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:10.633283 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-88edc653-2e42-4639-9fe7-99210c925388 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:10.633718 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-88edc653-2e42-4639-9fe7-99210c925388 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:11.016996 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-88edc653-2e42-4639-9fe7-99210c925388 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:11.029813 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-88edc653-2e42-4639-9fe7-99210c925388 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.413522 Jun 02 13:56:11.030414 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 140/292] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:10 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:56:11.246834 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Flavor limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:56:11.247608 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Image limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:56:11.248271 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Flavor pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:56:11.248826 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Image pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:56:11.249334 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:56:11.261914 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:11.264674 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:11.267956 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:11.268671 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:11.308563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for project 8f72940f7df74b898595c0ed9c654502. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:56:11.321751 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for user b8d05eeb8ac146969b99d33084f1664c and project 8f72940f7df74b898595c0ed9c654502. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:56:11.338502 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Going to run 1 instances... {{(pid=118316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:56:11.341595 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:56:11.522524 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-84a33be4-e7c3-482a-9df3-52933f4a2ce5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.164309 Jun 02 13:56:11.523876 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 153/293] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 13:56:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 2166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:56:11.535808 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b55a52cf-d281-441c-a20d-5c758b022b8e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:11.537093 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b55a52cf-d281-441c-a20d-5c758b022b8e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:11.648121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b55a52cf-d281-441c-a20d-5c758b022b8e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:11.675826 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b55a52cf-d281-441c-a20d-5c758b022b8e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1240 microversion: 2.1 time: 0.143271 Jun 02 13:56:11.685223 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 141/294] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:11 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1240 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:12.050734 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d0a7df3c-a6e0-4b42-b7a1-6059676a226b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:12.052229 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d0a7df3c-a6e0-4b42-b7a1-6059676a226b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:12.085821 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d0a7df3c-a6e0-4b42-b7a1-6059676a226b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:12.086285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d0a7df3c-a6e0-4b42-b7a1-6059676a226b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:12.087108 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d0a7df3c-a6e0-4b42-b7a1-6059676a226b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:12.087611 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d0a7df3c-a6e0-4b42-b7a1-6059676a226b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:12.402826 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d0a7df3c-a6e0-4b42-b7a1-6059676a226b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:12.414604 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d0a7df3c-a6e0-4b42-b7a1-6059676a226b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.367599 Jun 02 13:56:12.426726 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 154/295] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:12 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:12.698893 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c91bca03-1e4f-4b15-8be1-f182e9ebcf38 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:12.700990 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c91bca03-1e4f-4b15-8be1-f182e9ebcf38 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:12.820246 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c91bca03-1e4f-4b15-8be1-f182e9ebcf38 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:12.842304 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c91bca03-1e4f-4b15-8be1-f182e9ebcf38 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1240 microversion: 2.1 time: 0.150092 Jun 02 13:56:12.854535 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 142/296] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:12 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1240 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:13.432491 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-311db0d3-c5cc-4e66-9cb0-0c86f1aea0b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:13.433113 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-311db0d3-c5cc-4e66-9cb0-0c86f1aea0b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:13.451014 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-311db0d3-c5cc-4e66-9cb0-0c86f1aea0b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:13.451732 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-311db0d3-c5cc-4e66-9cb0-0c86f1aea0b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:13.452779 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-311db0d3-c5cc-4e66-9cb0-0c86f1aea0b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:13.453685 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-311db0d3-c5cc-4e66-9cb0-0c86f1aea0b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:13.712662 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-311db0d3-c5cc-4e66-9cb0-0c86f1aea0b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:13.720720 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-311db0d3-c5cc-4e66-9cb0-0c86f1aea0b9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.292234 Jun 02 13:56:13.721406 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 155/297] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:13 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:13.866401 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d57d265c-25c0-4b18-82bf-34837f5cdee2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:13.867844 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d57d265c-25c0-4b18-82bf-34837f5cdee2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:13.881632 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d57d265c-25c0-4b18-82bf-34837f5cdee2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:13.884835 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d57d265c-25c0-4b18-82bf-34837f5cdee2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:13.885831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d57d265c-25c0-4b18-82bf-34837f5cdee2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:13.888619 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d57d265c-25c0-4b18-82bf-34837f5cdee2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:14.072594 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d57d265c-25c0-4b18-82bf-34837f5cdee2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:14.088569 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d57d265c-25c0-4b18-82bf-34837f5cdee2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1244 microversion: 2.1 time: 0.230189 Jun 02 13:56:14.089295 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 143/298] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:13 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1244 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:56:14.740433 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4c697212-aba9-49a5-b954-047154f598e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:14.743108 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4c697212-aba9-49a5-b954-047154f598e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:14.752996 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4c697212-aba9-49a5-b954-047154f598e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:14.753537 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4c697212-aba9-49a5-b954-047154f598e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:14.754493 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4c697212-aba9-49a5-b954-047154f598e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:14.754930 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4c697212-aba9-49a5-b954-047154f598e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:15.073705 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4c697212-aba9-49a5-b954-047154f598e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:15.088357 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4c697212-aba9-49a5-b954-047154f598e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.352649 Jun 02 13:56:15.089220 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 156/299] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:14 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:15.105687 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-27f75f1e-2ec5-4d27-a02a-ae42b586958a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:15.106455 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-27f75f1e-2ec5-4d27-a02a-ae42b586958a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:15.118421 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-27f75f1e-2ec5-4d27-a02a-ae42b586958a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:15.119099 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-27f75f1e-2ec5-4d27-a02a-ae42b586958a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:15.120346 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-27f75f1e-2ec5-4d27-a02a-ae42b586958a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:15.121186 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-27f75f1e-2ec5-4d27-a02a-ae42b586958a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:15.397889 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-27f75f1e-2ec5-4d27-a02a-ae42b586958a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:15.417342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-27f75f1e-2ec5-4d27-a02a-ae42b586958a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1244 microversion: 2.1 time: 0.315424 Jun 02 13:56:15.422992 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 144/300] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:15 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1244 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:16.115239 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8c07d510-cdfd-4c8b-b056-eb667d4f2677 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:16.115908 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8c07d510-cdfd-4c8b-b056-eb667d4f2677 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:16.131198 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8c07d510-cdfd-4c8b-b056-eb667d4f2677 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:16.132050 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8c07d510-cdfd-4c8b-b056-eb667d4f2677 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:16.134645 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8c07d510-cdfd-4c8b-b056-eb667d4f2677 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:16.135473 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8c07d510-cdfd-4c8b-b056-eb667d4f2677 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:16.438120 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0b0ce4dd-1c02-42f7-ac03-8ac875e5d189 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:16.438737 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0b0ce4dd-1c02-42f7-ac03-8ac875e5d189 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:16.446659 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0b0ce4dd-1c02-42f7-ac03-8ac875e5d189 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:16.447485 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0b0ce4dd-1c02-42f7-ac03-8ac875e5d189 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:16.448529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0b0ce4dd-1c02-42f7-ac03-8ac875e5d189 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:16.449167 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0b0ce4dd-1c02-42f7-ac03-8ac875e5d189 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:16.628032 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0b0ce4dd-1c02-42f7-ac03-8ac875e5d189 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:16.641245 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0b0ce4dd-1c02-42f7-ac03-8ac875e5d189 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1236 microversion: 2.1 time: 0.206745 Jun 02 13:56:16.642506 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 145/301] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:16 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1236 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:16.777013 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8c07d510-cdfd-4c8b-b056-eb667d4f2677 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:16.785363 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8c07d510-cdfd-4c8b-b056-eb667d4f2677 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.676570 Jun 02 13:56:16.786526 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 157/302] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:16 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:17.660609 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0091a09d-f0d6-4080-b8a3-5384df404aff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:17.661349 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0091a09d-f0d6-4080-b8a3-5384df404aff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:17.684030 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0091a09d-f0d6-4080-b8a3-5384df404aff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:17.684876 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0091a09d-f0d6-4080-b8a3-5384df404aff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:17.689964 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0091a09d-f0d6-4080-b8a3-5384df404aff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:17.701892 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0091a09d-f0d6-4080-b8a3-5384df404aff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:17.803645 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-467fdd5a-f793-4511-b8b7-4004d4d3fe94 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:17.804930 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-467fdd5a-f793-4511-b8b7-4004d4d3fe94 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:17.811682 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-467fdd5a-f793-4511-b8b7-4004d4d3fe94 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:17.812331 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-467fdd5a-f793-4511-b8b7-4004d4d3fe94 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:17.813306 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-467fdd5a-f793-4511-b8b7-4004d4d3fe94 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:17.813898 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-467fdd5a-f793-4511-b8b7-4004d4d3fe94 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:17.821218 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0091a09d-f0d6-4080-b8a3-5384df404aff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:17.831677 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0091a09d-f0d6-4080-b8a3-5384df404aff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1292 microversion: 2.1 time: 0.175229 Jun 02 13:56:17.834992 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 146/303] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:17 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1292 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:17.875773 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=81 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:18.648092 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-467fdd5a-f793-4511-b8b7-4004d4d3fe94 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:18.655591 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-467fdd5a-f793-4511-b8b7-4004d4d3fe94 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.857051 Jun 02 13:56:18.656500 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 158/304] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:17 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:18.856432 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a8e37c5a-f6f0-41c1-98c9-e60cf8420565 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:18.860254 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a8e37c5a-f6f0-41c1-98c9-e60cf8420565 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:18.882401 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8e37c5a-f6f0-41c1-98c9-e60cf8420565 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:18.886260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8e37c5a-f6f0-41c1-98c9-e60cf8420565 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:18.890000 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8e37c5a-f6f0-41c1-98c9-e60cf8420565 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:18.890998 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8e37c5a-f6f0-41c1-98c9-e60cf8420565 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:19.076998 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a8e37c5a-f6f0-41c1-98c9-e60cf8420565 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:19.092671 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a8e37c5a-f6f0-41c1-98c9-e60cf8420565 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1300 microversion: 2.1 time: 0.241835 Jun 02 13:56:19.093521 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 147/305] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:18 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1300 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:19.680954 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3b0b6905-1e0e-4686-be03-d3e71e51aa03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:19.682668 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3b0b6905-1e0e-4686-be03-d3e71e51aa03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:19.696041 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3b0b6905-1e0e-4686-be03-d3e71e51aa03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:19.696802 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3b0b6905-1e0e-4686-be03-d3e71e51aa03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:19.700658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3b0b6905-1e0e-4686-be03-d3e71e51aa03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:19.700658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3b0b6905-1e0e-4686-be03-d3e71e51aa03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:20.111121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-54a98b28-2f4e-4d75-b1eb-f893486b0b1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:20.111900 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-54a98b28-2f4e-4d75-b1eb-f893486b0b1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:20.129883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54a98b28-2f4e-4d75-b1eb-f893486b0b1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:20.132590 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54a98b28-2f4e-4d75-b1eb-f893486b0b1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:20.132590 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54a98b28-2f4e-4d75-b1eb-f893486b0b1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:20.134759 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54a98b28-2f4e-4d75-b1eb-f893486b0b1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:20.440466 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3b0b6905-1e0e-4686-be03-d3e71e51aa03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:20.453838 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3b0b6905-1e0e-4686-be03-d3e71e51aa03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1501 microversion: 2.1 time: 0.782315 Jun 02 13:56:20.455751 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 159/306] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:19 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1501 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:20.463908 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-54a98b28-2f4e-4d75-b1eb-f893486b0b1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:20.471503 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e3a5da8a-08eb-4a89-b5aa-33486303c8c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4b6a8d9-fd8f-489e-9ad7-35dcdb57eb9a"}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:56:20.473664 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-54a98b28-2f4e-4d75-b1eb-f893486b0b1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1298 microversion: 2.1 time: 0.366374 Jun 02 13:56:20.478019 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e3a5da8a-08eb-4a89-b5aa-33486303c8c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:20.484223 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 148/307] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:20 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1298 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:56:20.491316 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e3a5da8a-08eb-4a89-b5aa-33486303c8c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:20.494729 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e3a5da8a-08eb-4a89-b5aa-33486303c8c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:20.495632 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e3a5da8a-08eb-4a89-b5aa-33486303c8c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:20.498526 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e3a5da8a-08eb-4a89-b5aa-33486303c8c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:20.614926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-e3a5da8a-08eb-4a89-b5aa-33486303c8c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] HTTP exception thrown: Cannot 'attach_volume' instance 478fcfd0-657e-41c0-b9f2-38f449129a3b while it is in vm_state rescued Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e3a5da8a-08eb-4a89-b5aa-33486303c8c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Request method failure captured: Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: POST /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b/os-volume_attachments HTTP/1.1 Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 74 Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMD8es0jslrTw9H8zr0XMa1qVV_2yPyM188swiKF6vue0UYQNpH_rsvPjYaA-2ztdEbY44YK_QxUDWq9XJNDE3-Kz8Vz5C4hu7UZU9-dLcdNvHGNma-2ZrgZ_BK-9VNICseKjoeXmiFPmRH8MNBMa_-WjWv-iCJzdGCPmtouVpcN-84 Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: b067e3c448e24f179830992fecf65399 Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 13:56:20.622770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 13:56:20.624394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b067e3c448e24f179830992fecf65399"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b067e3c448e24f179830992fecf65399"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b067e3c448e24f179830992fecf65399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b067e3c448e24f179830992fecf65399"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 13:56:20.624394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 13:56:20.624394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: b067e3c448e24f179830992fecf65399 Jun 02 13:56:20.624394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 13:56:20.624394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-ServerRescueNegativeTestJSON-1754502689-project Jun 02 13:56:20.624394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 13:56:20.624394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 13:56:20.624394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: f9e57606c14a4ad99612414c1f9719f4 Jun 02 13:56:20.624394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1754502689-project Jun 02 13:56:20.624394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Jun 02 13:56:20.624394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {"volumeAttachment": {"volumeId": "a4b6a8d9-fd8f-489e-9ad7-35dcdb57eb9a"}} Jun 02 13:56:20.624394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Cannot 'attach_volume' instance 478fcfd0-657e-41c0-b9f2-38f449129a3b while it is in vm_state rescued Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'server_id': '478fcfd0-657e-41c0-b9f2-38f449129a3b', 'body': {'volumeAttachment': {'volumeId': 'a4b6a8d9-fd8f-489e-9ad7-35dcdb57eb9a'}}} Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 478fcfd0-657e-41c0-b9f2-38f449129a3b in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:56:20.630845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 478fcfd0-657e-41c0-b9f2-38f449129a3b while it is in vm_state rescued Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:56:20.632911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:56:20.634247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:56:20.634247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:56:20.634247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 478fcfd0-657e-41c0-b9f2-38f449129a3b while it is in vm_state rescued Jun 02 13:56:20.634247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 13:56:20.634247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e3a5da8a-08eb-4a89-b5aa-33486303c8c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Returning 409 to user: Cannot 'attach_volume' instance 478fcfd0-657e-41c0-b9f2-38f449129a3b while it is in vm_state rescued {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:56:20.637893 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e3a5da8a-08eb-4a89-b5aa-33486303c8c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "POST /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.157128 Jun 02 13:56:20.639292 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 160/308] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 2 13:56:20 2022] POST /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b/os-volume_attachments => generated 152 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 02 13:56:20.649989 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ebda5995-2c06-4519-82a9-3f0ae74fce03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:56:20.650626 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ebda5995-2c06-4519-82a9-3f0ae74fce03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:20.664578 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ebda5995-2c06-4519-82a9-3f0ae74fce03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:20.665495 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ebda5995-2c06-4519-82a9-3f0ae74fce03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:20.668529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ebda5995-2c06-4519-82a9-3f0ae74fce03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:20.669078 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ebda5995-2c06-4519-82a9-3f0ae74fce03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:20.989489 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ebda5995-2c06-4519-82a9-3f0ae74fce03 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "POST /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b/action" status: 202 len: 0 microversion: 2.1 time: 0.344042 Jun 02 13:56:21.001952 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f42f4be4-b403-42b8-b7f9-99bf6a23d864 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:21.003586 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f42f4be4-b403-42b8-b7f9-99bf6a23d864 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:21.005931 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 149/309] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 2 13:56:20 2022] POST /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:56:21.016207 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f42f4be4-b403-42b8-b7f9-99bf6a23d864 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:21.022472 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f42f4be4-b403-42b8-b7f9-99bf6a23d864 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:21.023701 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f42f4be4-b403-42b8-b7f9-99bf6a23d864 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:21.031233 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f42f4be4-b403-42b8-b7f9-99bf6a23d864 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:21.293476 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:21.337143 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=10 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:21.493181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3b064844-96aa-45d6-ab28-43bdd64d2bbc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:21.494504 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3b064844-96aa-45d6-ab28-43bdd64d2bbc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:21.522184 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3b064844-96aa-45d6-ab28-43bdd64d2bbc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:21.522639 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3b064844-96aa-45d6-ab28-43bdd64d2bbc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:21.525282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3b064844-96aa-45d6-ab28-43bdd64d2bbc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:21.525282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3b064844-96aa-45d6-ab28-43bdd64d2bbc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:22.327705 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3b064844-96aa-45d6-ab28-43bdd64d2bbc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:22.345948 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3b064844-96aa-45d6-ab28-43bdd64d2bbc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1365 microversion: 2.1 time: 0.857322 Jun 02 13:56:22.354960 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 150/310] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:21 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1365 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:22.733153 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f42f4be4-b403-42b8-b7f9-99bf6a23d864 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:22.733153 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f42f4be4-b403-42b8-b7f9-99bf6a23d864 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1509 microversion: 2.1 time: 1.593353 Jun 02 13:56:22.733153 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 161/311] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:20 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1509 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:23.373743 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-bc65783c-6b82-4279-ab1f-93704ed2b46f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:23.374519 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-bc65783c-6b82-4279-ab1f-93704ed2b46f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:23.377350 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=4 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:23.393005 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bc65783c-6b82-4279-ab1f-93704ed2b46f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:23.400637 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bc65783c-6b82-4279-ab1f-93704ed2b46f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:23.401658 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bc65783c-6b82-4279-ab1f-93704ed2b46f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:23.407809 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bc65783c-6b82-4279-ab1f-93704ed2b46f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:23.744806 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2a81eb4b-a168-43d9-817d-90fa309a3cc3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:23.745905 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2a81eb4b-a168-43d9-817d-90fa309a3cc3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:23.765718 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2a81eb4b-a168-43d9-817d-90fa309a3cc3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:23.766165 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2a81eb4b-a168-43d9-817d-90fa309a3cc3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:23.766933 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2a81eb4b-a168-43d9-817d-90fa309a3cc3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:23.767361 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2a81eb4b-a168-43d9-817d-90fa309a3cc3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:24.229104 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-bc65783c-6b82-4279-ab1f-93704ed2b46f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:24.242805 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-bc65783c-6b82-4279-ab1f-93704ed2b46f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1365 microversion: 2.1 time: 0.872588 Jun 02 13:56:24.243607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 151/312] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:23 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1365 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:24.260983 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-c8a7c66f-90f0-4233-ada8-c152f1ba2854 req-bdfd2791-1527-4b1d-a57b-88d4c1aaca53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ee5a26-ff9a-4c58-98a4-2664248a553f", "tag": "655f824c-2cda-4ff5-9c52-ef0a03e0689a"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:56:24.278509 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=46 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:24.285097 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-c8a7c66f-90f0-4233-ada8-c152f1ba2854 req-bdfd2791-1527-4b1d-a57b-88d4c1aaca53 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:24.286376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-c8a7c66f-90f0-4233-ada8-c152f1ba2854 req-bdfd2791-1527-4b1d-a57b-88d4c1aaca53 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:24.308381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2a81eb4b-a168-43d9-817d-90fa309a3cc3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:24.314315 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-c8a7c66f-90f0-4233-ada8-c152f1ba2854 req-bdfd2791-1527-4b1d-a57b-88d4c1aaca53 service nova] Creating event network-changed:655f824c-2cda-4ff5-9c52-ef0a03e0689a for instance c4ee5a26-ff9a-4c58-98a4-2664248a553f on hv-cinder-82651 Jun 02 13:56:24.322946 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2a81eb4b-a168-43d9-817d-90fa309a3cc3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1509 microversion: 2.1 time: 0.589180 Jun 02 13:56:24.323858 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 162/313] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:23 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1509 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:24.333621 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-c8a7c66f-90f0-4233-ada8-c152f1ba2854 req-bdfd2791-1527-4b1d-a57b-88d4c1aaca53 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086673 Jun 02 13:56:24.336457 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 152/314] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:56:25.263416 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b1bbe646-f352-4428-a1cc-ac26672c3cc1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:25.265376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b1bbe646-f352-4428-a1cc-ac26672c3cc1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:25.284201 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b1bbe646-f352-4428-a1cc-ac26672c3cc1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:25.285313 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b1bbe646-f352-4428-a1cc-ac26672c3cc1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:25.286096 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b1bbe646-f352-4428-a1cc-ac26672c3cc1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:25.286733 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b1bbe646-f352-4428-a1cc-ac26672c3cc1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:25.492449 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-87e95b89-7d21-4b81-a272-452962d05fee tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Action: 'create', calling method: .version_select at 0x7fb720125f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1891088145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6QQxbcAl/sIHXXHe70ts9XTTcNu5sLjweZUT2UbNo9F+BQNBAz/5DIW55uvkt9b5FROcs1V4a54nsRKUTIJnYnuYsohHajgu0x2cBO0sOAyNQyxXPLUlLr1h2YMQ4rpQ=="}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:56:25.560451 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-87e95b89-7d21-4b81-a272-452962d05fee tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Getting quotas for project b55a34a53b2740d9af5efd660424a456. Resources: {'key_pairs'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:56:25.569041 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-87e95b89-7d21-4b81-a272-452962d05fee tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Getting quotas for user 315c0d9d9a284389ae07bf898c330605 and project b55a34a53b2740d9af5efd660424a456. Resources: {'key_pairs'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:56:25.594280 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b1bbe646-f352-4428-a1cc-ac26672c3cc1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:25.607736 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b1bbe646-f352-4428-a1cc-ac26672c3cc1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1365 microversion: 2.1 time: 0.350017 Jun 02 13:56:25.608328 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 153/315] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:25 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1365 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:56:25.614829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-50c4ac5e-7896-4044-9404-39325df3f89f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:25.615674 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-50c4ac5e-7896-4044-9404-39325df3f89f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:25.626492 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-50c4ac5e-7896-4044-9404-39325df3f89f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:25.626492 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-50c4ac5e-7896-4044-9404-39325df3f89f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:25.630004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-50c4ac5e-7896-4044-9404-39325df3f89f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:25.631225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-50c4ac5e-7896-4044-9404-39325df3f89f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:25.703428 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-87e95b89-7d21-4b81-a272-452962d05fee tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.702977 Jun 02 13:56:25.706356 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 163/316] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 2 13:56:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:56:25.956679 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-50c4ac5e-7896-4044-9404-39325df3f89f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:25.969626 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-50c4ac5e-7896-4044-9404-39325df3f89f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1509 microversion: 2.1 time: 0.360180 Jun 02 13:56:25.970879 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 154/317] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:25 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1509 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:26.151738 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-218672c5-8456-4d5a-952b-b43557b32c3e tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Action: 'create', calling method: .version_select at 0x7fb720084670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1654500253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/zorZhS9Ls96PZj21WrIL6nLIL/ybaBZ+W6Kw3d1i0uqd6WD3m0vNejyc9uDaAZYPsDhmlkfBnqJUPta+DAG5dc/9eJK1Wr83R7CJ6fFUR82y3TfGacKK0AvdcqLTAXQ=="}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:56:26.186183 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-218672c5-8456-4d5a-952b-b43557b32c3e tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Getting quotas for project c5c02b70c6fa4d4b999cca3d9f6154c5. Resources: {'key_pairs'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:56:26.207689 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-218672c5-8456-4d5a-952b-b43557b32c3e tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Getting quotas for user 198160f6a7524bbb9f90798d2269db00 and project c5c02b70c6fa4d4b999cca3d9f6154c5. Resources: {'key_pairs'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:56:26.326480 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-218672c5-8456-4d5a-952b-b43557b32c3e tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.360827 Jun 02 13:56:26.327570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 164/318] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 2 13:56:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:56:26.625382 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d6b5c4f7-2b6f-4168-9233-cd9fdf4d68f1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:26.626570 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d6b5c4f7-2b6f-4168-9233-cd9fdf4d68f1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:26.637565 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d6b5c4f7-2b6f-4168-9233-cd9fdf4d68f1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:26.637994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d6b5c4f7-2b6f-4168-9233-cd9fdf4d68f1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:26.638756 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d6b5c4f7-2b6f-4168-9233-cd9fdf4d68f1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:26.639184 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d6b5c4f7-2b6f-4168-9233-cd9fdf4d68f1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:26.643667 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:26.876979 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d6b5c4f7-2b6f-4168-9233-cd9fdf4d68f1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:26.889272 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d6b5c4f7-2b6f-4168-9233-cd9fdf4d68f1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1365 microversion: 2.1 time: 0.265659 Jun 02 13:56:26.902025 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 155/319] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:26 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:26.988503 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-10232bcb-6e3a-458e-baee-32526932d373 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:26.989351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-10232bcb-6e3a-458e-baee-32526932d373 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:26.996187 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-10232bcb-6e3a-458e-baee-32526932d373 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:26.996936 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-10232bcb-6e3a-458e-baee-32526932d373 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:26.997806 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-10232bcb-6e3a-458e-baee-32526932d373 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:26.998356 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-10232bcb-6e3a-458e-baee-32526932d373 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:27.285672 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-10232bcb-6e3a-458e-baee-32526932d373 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:27.309017 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-10232bcb-6e3a-458e-baee-32526932d373 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1509 microversion: 2.1 time: 0.313570 Jun 02 13:56:27.309017 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 165/320] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:26 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1509 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:27.910018 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a0341704-2815-4e02-a8df-665660a598ca tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:27.910808 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a0341704-2815-4e02-a8df-665660a598ca tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:27.939484 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a0341704-2815-4e02-a8df-665660a598ca tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:27.941847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a0341704-2815-4e02-a8df-665660a598ca tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:27.943861 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a0341704-2815-4e02-a8df-665660a598ca tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:27.945579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a0341704-2815-4e02-a8df-665660a598ca tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:28.223043 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a0341704-2815-4e02-a8df-665660a598ca tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:28.240157 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a0341704-2815-4e02-a8df-665660a598ca tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1365 microversion: 2.1 time: 0.329744 Jun 02 13:56:28.240157 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 156/321] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:27 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1365 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:28.316061 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-bcffc971-bcfc-4bbb-af32-b232cfac73d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:28.316824 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-bcffc971-bcfc-4bbb-af32-b232cfac73d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:28.326827 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bcffc971-bcfc-4bbb-af32-b232cfac73d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:28.327967 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bcffc971-bcfc-4bbb-af32-b232cfac73d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:28.329792 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bcffc971-bcfc-4bbb-af32-b232cfac73d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:28.332809 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bcffc971-bcfc-4bbb-af32-b232cfac73d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:28.728888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-bcffc971-bcfc-4bbb-af32-b232cfac73d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:28.739584 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-bcffc971-bcfc-4bbb-af32-b232cfac73d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1515 microversion: 2.1 time: 0.427900 Jun 02 13:56:28.742836 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 166/322] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:28 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1515 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:29.252826 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b26fc32e-e0f8-4934-a2e5-e7105ba17fb7 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:29.254235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b26fc32e-e0f8-4934-a2e5-e7105ba17fb7 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:29.271716 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b26fc32e-e0f8-4934-a2e5-e7105ba17fb7 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:29.273026 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b26fc32e-e0f8-4934-a2e5-e7105ba17fb7 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:29.276008 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b26fc32e-e0f8-4934-a2e5-e7105ba17fb7 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:29.277449 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b26fc32e-e0f8-4934-a2e5-e7105ba17fb7 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:29.562144 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b26fc32e-e0f8-4934-a2e5-e7105ba17fb7 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:29.572185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b26fc32e-e0f8-4934-a2e5-e7105ba17fb7 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1365 microversion: 2.1 time: 0.324064 Jun 02 13:56:29.574038 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 157/323] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:29 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:30.606647 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0ad30c0c-b3ec-48de-ab19-e77603f37648 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:30.609433 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0ad30c0c-b3ec-48de-ab19-e77603f37648 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:30.617804 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ad30c0c-b3ec-48de-ab19-e77603f37648 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:30.618252 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ad30c0c-b3ec-48de-ab19-e77603f37648 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:30.620778 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ad30c0c-b3ec-48de-ab19-e77603f37648 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:30.621356 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ad30c0c-b3ec-48de-ab19-e77603f37648 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:30.814084 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0ad30c0c-b3ec-48de-ab19-e77603f37648 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:30.825343 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0ad30c0c-b3ec-48de-ab19-e77603f37648 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1365 microversion: 2.1 time: 0.238289 Jun 02 13:56:30.826643 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 167/324] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:30 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:31.776343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f7358b90-ff02-4670-8de9-cafbcf2389ad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Action: 'create', calling method: .version_select at 0x7fb720040940>, body: {"keypair": {"name": "tempest-keypair-636255136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh8UydYpHeGPjH2Dgw7LoE0Oe4g5VoXXhurmRyXvcSeKYKYC7jlAME0FpI5l1m0DsEfpVvVDnWm7d/5eyL+g4RQWcP/NJgPtjZErRACjBB5yO1KkewPGLr8Uede3JInVg=="}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:56:31.798222 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-f7358b90-ff02-4670-8de9-cafbcf2389ad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Getting quotas for project b067e3c448e24f179830992fecf65399. Resources: {'key_pairs'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:56:31.803475 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-f7358b90-ff02-4670-8de9-cafbcf2389ad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Getting quotas for user f9e57606c14a4ad99612414c1f9719f4 and project b067e3c448e24f179830992fecf65399. Resources: {'key_pairs'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:56:31.842429 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-24adc708-80e5-4aa5-a7b3-459615775b04 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:31.844519 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-24adc708-80e5-4aa5-a7b3-459615775b04 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:31.850720 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-24adc708-80e5-4aa5-a7b3-459615775b04 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:31.851215 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-24adc708-80e5-4aa5-a7b3-459615775b04 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:31.851889 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-24adc708-80e5-4aa5-a7b3-459615775b04 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:31.852316 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-24adc708-80e5-4aa5-a7b3-459615775b04 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:31.921271 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f7358b90-ff02-4670-8de9-cafbcf2389ad tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.148987 Jun 02 13:56:31.921870 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 158/325] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 2 13:56:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:56:32.000240 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-24adc708-80e5-4aa5-a7b3-459615775b04 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:32.008371 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-24adc708-80e5-4aa5-a7b3-459615775b04 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1365 microversion: 2.1 time: 0.169726 Jun 02 13:56:32.008959 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 168/326] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:31 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:56:33.029221 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-aa373545-7777-4a8f-812e-6c5ca90a372a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:33.030266 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-aa373545-7777-4a8f-812e-6c5ca90a372a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:33.040306 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-aa373545-7777-4a8f-812e-6c5ca90a372a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:33.041024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-aa373545-7777-4a8f-812e-6c5ca90a372a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:33.042197 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-aa373545-7777-4a8f-812e-6c5ca90a372a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:33.042879 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-aa373545-7777-4a8f-812e-6c5ca90a372a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:33.243206 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-aa373545-7777-4a8f-812e-6c5ca90a372a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:33.251463 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-aa373545-7777-4a8f-812e-6c5ca90a372a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1365 microversion: 2.1 time: 0.229288 Jun 02 13:56:33.252119 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 159/327] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:33 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:34.268356 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-70faa57d-8b07-40d1-928f-e2379c6d37fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:34.269729 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-70faa57d-8b07-40d1-928f-e2379c6d37fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:34.276352 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-70faa57d-8b07-40d1-928f-e2379c6d37fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:34.277077 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-70faa57d-8b07-40d1-928f-e2379c6d37fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:34.277835 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-70faa57d-8b07-40d1-928f-e2379c6d37fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:34.278268 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-70faa57d-8b07-40d1-928f-e2379c6d37fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:34.419318 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-70faa57d-8b07-40d1-928f-e2379c6d37fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:34.427746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-70faa57d-8b07-40d1-928f-e2379c6d37fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1365 microversion: 2.1 time: 0.163242 Jun 02 13:56:34.428357 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 169/328] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:34 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:34.858542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-196941243", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d18c7729-7b7d-45e9-aff0-7bcd407a86fb"}], "security_groups": [{"name": "tempest-securitygroup--86559704"}], "key_name": "tempest-keypair-636255136", "user_data": "}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:56:35.248943 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-4454aa4c-84d2-4960-9af3-8ddc71d02a19 req-960c8323-fc69-4bda-a684-974837fa3e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ee5a26-ff9a-4c58-98a4-2664248a553f", "name": "network-vif-plugged", "status": "completed", "tag": "655f824c-2cda-4ff5-9c52-ef0a03e0689a"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:56:35.252651 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:35.258828 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-4454aa4c-84d2-4960-9af3-8ddc71d02a19 req-960c8323-fc69-4bda-a684-974837fa3e9a service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:35.259332 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-4454aa4c-84d2-4960-9af3-8ddc71d02a19 req-960c8323-fc69-4bda-a684-974837fa3e9a service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:35.271309 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-4454aa4c-84d2-4960-9af3-8ddc71d02a19 req-960c8323-fc69-4bda-a684-974837fa3e9a service nova] Creating event network-vif-plugged:655f824c-2cda-4ff5-9c52-ef0a03e0689a for instance c4ee5a26-ff9a-4c58-98a4-2664248a553f on hv-cinder-82651 Jun 02 13:56:35.277209 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-4454aa4c-84d2-4960-9af3-8ddc71d02a19 req-960c8323-fc69-4bda-a684-974837fa3e9a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032035 Jun 02 13:56:35.278107 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 170/329] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:56:35.447084 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7ce7f681-b107-40a0-955b-678274f2e338 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:35.447804 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7ce7f681-b107-40a0-955b-678274f2e338 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:35.454339 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ce7f681-b107-40a0-955b-678274f2e338 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:35.454771 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ce7f681-b107-40a0-955b-678274f2e338 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:35.455535 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ce7f681-b107-40a0-955b-678274f2e338 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:35.455955 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ce7f681-b107-40a0-955b-678274f2e338 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:35.688777 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7ce7f681-b107-40a0-955b-678274f2e338 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:35.708565 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7ce7f681-b107-40a0-955b-678274f2e338 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1365 microversion: 2.1 time: 0.265892 Jun 02 13:56:35.713774 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 171/330] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:35 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:35.726509 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.network.neutron [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] validate_networks() for [('d18c7729-7b7d-45e9-aff0-7bcd407a86fb', None, None, None, None, None)] {{(pid=118315) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:56:36.156168 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Flavor limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:56:36.156768 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Image limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:56:36.157080 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Flavor pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:56:36.157476 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Image pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:56:36.157881 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:56:36.167960 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:36.168438 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:36.169206 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:36.169680 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:36.187837 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Getting quotas for project b067e3c448e24f179830992fecf65399. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:56:36.195714 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Getting quotas for user f9e57606c14a4ad99612414c1f9719f4 and project b067e3c448e24f179830992fecf65399. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:56:36.206427 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Going to run 1 instances... {{(pid=118315) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:56:36.208901 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118315) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:56:36.412550 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c31dd2e2-83f8-4655-8c90-48ff0e00d5a3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.558269 Jun 02 13:56:36.413202 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 160/331] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 13:56:34 2022] POST /compute/v2.1/servers => generated 407 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:56:36.423755 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7ca37a9a-ecad-4189-bccc-d15651260d84 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:36.425700 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7ca37a9a-ecad-4189-bccc-d15651260d84 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:36.431490 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=8 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:36.484077 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7ca37a9a-ecad-4189-bccc-d15651260d84 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:36.491342 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7ca37a9a-ecad-4189-bccc-d15651260d84 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1244 microversion: 2.1 time: 0.071958 Jun 02 13:56:36.492153 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 172/332] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:36 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1244 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:36.729168 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-063d6917-853c-4a12-a41e-07a872b9b444 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:36.729775 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-063d6917-853c-4a12-a41e-07a872b9b444 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:36.737610 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-063d6917-853c-4a12-a41e-07a872b9b444 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:36.740132 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-063d6917-853c-4a12-a41e-07a872b9b444 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:36.740132 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-063d6917-853c-4a12-a41e-07a872b9b444 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:36.740132 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-063d6917-853c-4a12-a41e-07a872b9b444 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:36.888786 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-063d6917-853c-4a12-a41e-07a872b9b444 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:36.918644 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-063d6917-853c-4a12-a41e-07a872b9b444 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1365 microversion: 2.1 time: 0.193388 Jun 02 13:56:36.919922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 161/333] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:36 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:37.513898 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a607a15b-78c3-4108-a210-ffefc9fefc67 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:37.514520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a607a15b-78c3-4108-a210-ffefc9fefc67 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:37.567801 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a607a15b-78c3-4108-a210-ffefc9fefc67 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:37.574507 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a607a15b-78c3-4108-a210-ffefc9fefc67 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1244 microversion: 2.1 time: 0.068348 Jun 02 13:56:37.575320 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 173/334] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:37 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1244 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:37.935688 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d73c2af0-39d9-458a-91f7-4f99e87d4ba8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:37.936301 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d73c2af0-39d9-458a-91f7-4f99e87d4ba8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:37.943131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d73c2af0-39d9-458a-91f7-4f99e87d4ba8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:37.943559 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d73c2af0-39d9-458a-91f7-4f99e87d4ba8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:37.944318 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d73c2af0-39d9-458a-91f7-4f99e87d4ba8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:37.944786 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d73c2af0-39d9-458a-91f7-4f99e87d4ba8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:38.086320 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d73c2af0-39d9-458a-91f7-4f99e87d4ba8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:38.095604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d73c2af0-39d9-458a-91f7-4f99e87d4ba8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1365 microversion: 2.1 time: 0.163738 Jun 02 13:56:38.096186 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 162/335] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:37 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:38.591941 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-06fd9d5e-391e-4b5e-ae0c-7e1dfe344020 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:38.592587 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-06fd9d5e-391e-4b5e-ae0c-7e1dfe344020 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:38.600091 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-06fd9d5e-391e-4b5e-ae0c-7e1dfe344020 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:38.600568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-06fd9d5e-391e-4b5e-ae0c-7e1dfe344020 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:38.601334 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-06fd9d5e-391e-4b5e-ae0c-7e1dfe344020 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:38.601751 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-06fd9d5e-391e-4b5e-ae0c-7e1dfe344020 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:38.668430 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-06fd9d5e-391e-4b5e-ae0c-7e1dfe344020 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:38.684768 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-06fd9d5e-391e-4b5e-ae0c-7e1dfe344020 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1248 microversion: 2.1 time: 0.089993 Jun 02 13:56:38.684768 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 174/336] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:38 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1248 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:39.113186 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7633c66e-86ae-4e99-a013-5152d81d9a53 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:39.113768 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7633c66e-86ae-4e99-a013-5152d81d9a53 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:39.120299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7633c66e-86ae-4e99-a013-5152d81d9a53 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:39.120775 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7633c66e-86ae-4e99-a013-5152d81d9a53 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:39.125335 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7633c66e-86ae-4e99-a013-5152d81d9a53 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:39.125335 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7633c66e-86ae-4e99-a013-5152d81d9a53 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:39.259410 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7633c66e-86ae-4e99-a013-5152d81d9a53 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:39.266885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7633c66e-86ae-4e99-a013-5152d81d9a53 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1555 microversion: 2.1 time: 0.157681 Jun 02 13:56:39.267487 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 163/337] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:39 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:39.283843 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-43df6172-7bd6-4fea-8861-375f441bf056 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:39.284327 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-43df6172-7bd6-4fea-8861-375f441bf056 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:39.290247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-43df6172-7bd6-4fea-8861-375f441bf056 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:39.290709 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-43df6172-7bd6-4fea-8861-375f441bf056 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:39.291447 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-43df6172-7bd6-4fea-8861-375f441bf056 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:39.291871 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-43df6172-7bd6-4fea-8861-375f441bf056 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:39.374042 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-43df6172-7bd6-4fea-8861-375f441bf056 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093960 Jun 02 13:56:39.374630 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 175/338] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 2 13:56:39 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:56:39.695173 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c4e75d19-98d5-480c-ad46-2b72b75bfee0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:39.695809 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c4e75d19-98d5-480c-ad46-2b72b75bfee0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:39.702270 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c4e75d19-98d5-480c-ad46-2b72b75bfee0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:39.702716 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c4e75d19-98d5-480c-ad46-2b72b75bfee0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:39.703664 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c4e75d19-98d5-480c-ad46-2b72b75bfee0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:39.704426 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c4e75d19-98d5-480c-ad46-2b72b75bfee0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:39.834152 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c4e75d19-98d5-480c-ad46-2b72b75bfee0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:39.848877 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c4e75d19-98d5-480c-ad46-2b72b75bfee0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1304 microversion: 2.1 time: 0.158142 Jun 02 13:56:39.849508 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 164/339] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:39 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1304 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:40.865782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a8b0f496-a16d-46f6-bd10-fbb82508ce43 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:40.866990 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a8b0f496-a16d-46f6-bd10-fbb82508ce43 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:40.875587 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a8b0f496-a16d-46f6-bd10-fbb82508ce43 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:40.876350 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a8b0f496-a16d-46f6-bd10-fbb82508ce43 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:40.889429 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a8b0f496-a16d-46f6-bd10-fbb82508ce43 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:40.890750 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a8b0f496-a16d-46f6-bd10-fbb82508ce43 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:41.082069 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-c21079d8-0170-466c-93e6-3c05ca5f3199 req-7829e5ce-efa0-4c64-9d9c-32e8c71864ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ee5a26-ff9a-4c58-98a4-2664248a553f", "tag": "655f824c-2cda-4ff5-9c52-ef0a03e0689a"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:56:41.089822 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a8b0f496-a16d-46f6-bd10-fbb82508ce43 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:41.095098 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-c21079d8-0170-466c-93e6-3c05ca5f3199 req-7829e5ce-efa0-4c64-9d9c-32e8c71864ca service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:41.095555 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-c21079d8-0170-466c-93e6-3c05ca5f3199 req-7829e5ce-efa0-4c64-9d9c-32e8c71864ca service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:41.099055 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a8b0f496-a16d-46f6-bd10-fbb82508ce43 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.237322 Jun 02 13:56:41.108599 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-c21079d8-0170-466c-93e6-3c05ca5f3199 req-7829e5ce-efa0-4c64-9d9c-32e8c71864ca service nova] Creating event network-changed:655f824c-2cda-4ff5-9c52-ef0a03e0689a for instance c4ee5a26-ff9a-4c58-98a4-2664248a553f on hv-cinder-82651 Jun 02 13:56:41.109495 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 176/340] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:40 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:41.115498 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-c21079d8-0170-466c-93e6-3c05ca5f3199 req-7829e5ce-efa0-4c64-9d9c-32e8c71864ca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040745 Jun 02 13:56:41.122669 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 165/341] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:56:41.973625 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-1a7f7a11-ff69-4769-b32b-97d29f08275d req-857343bb-a1c7-4969-bbf9-49d748fc044d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c714d190-39b3-40b8-a7d0-da49a06fe5fa", "tag": "49169967-d46d-4a7e-b861-a60a2de510d4"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:56:42.001933 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-1a7f7a11-ff69-4769-b32b-97d29f08275d req-857343bb-a1c7-4969-bbf9-49d748fc044d service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:42.002377 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-1a7f7a11-ff69-4769-b32b-97d29f08275d req-857343bb-a1c7-4969-bbf9-49d748fc044d service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:42.026472 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-1a7f7a11-ff69-4769-b32b-97d29f08275d req-857343bb-a1c7-4969-bbf9-49d748fc044d service nova] Creating event network-changed:49169967-d46d-4a7e-b861-a60a2de510d4 for instance c714d190-39b3-40b8-a7d0-da49a06fe5fa on hv-cinder-82651 Jun 02 13:56:42.033667 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-1a7f7a11-ff69-4769-b32b-97d29f08275d req-857343bb-a1c7-4969-bbf9-49d748fc044d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064847 Jun 02 13:56:42.035100 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 177/342] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:56:42.116670 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a32493e8-5466-4165-bcbf-1538ddfd8d8c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:42.117637 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a32493e8-5466-4165-bcbf-1538ddfd8d8c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:42.133014 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a32493e8-5466-4165-bcbf-1538ddfd8d8c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:42.136275 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a32493e8-5466-4165-bcbf-1538ddfd8d8c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:42.136275 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a32493e8-5466-4165-bcbf-1538ddfd8d8c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:42.136275 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a32493e8-5466-4165-bcbf-1538ddfd8d8c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:42.294935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a32493e8-5466-4165-bcbf-1538ddfd8d8c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:42.303506 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a32493e8-5466-4165-bcbf-1538ddfd8d8c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.191571 Jun 02 13:56:42.304081 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 166/343] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:42 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:43.320947 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c7b3cf61-e365-4bf6-96ab-89740d0c1ff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:43.321632 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c7b3cf61-e365-4bf6-96ab-89740d0c1ff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:43.328256 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c7b3cf61-e365-4bf6-96ab-89740d0c1ff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:43.328738 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c7b3cf61-e365-4bf6-96ab-89740d0c1ff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:43.329523 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c7b3cf61-e365-4bf6-96ab-89740d0c1ff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:43.329958 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c7b3cf61-e365-4bf6-96ab-89740d0c1ff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:43.463289 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c7b3cf61-e365-4bf6-96ab-89740d0c1ff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:43.471001 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c7b3cf61-e365-4bf6-96ab-89740d0c1ff9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.154337 Jun 02 13:56:43.472356 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 178/344] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:43 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:44.488940 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b3d46d39-6d95-436a-aa22-ca4c87707c4a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:44.489549 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b3d46d39-6d95-436a-aa22-ca4c87707c4a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:44.496421 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b3d46d39-6d95-436a-aa22-ca4c87707c4a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:44.496867 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b3d46d39-6d95-436a-aa22-ca4c87707c4a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:44.497624 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b3d46d39-6d95-436a-aa22-ca4c87707c4a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:44.498076 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b3d46d39-6d95-436a-aa22-ca4c87707c4a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:44.643161 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b3d46d39-6d95-436a-aa22-ca4c87707c4a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:44.651308 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b3d46d39-6d95-436a-aa22-ca4c87707c4a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.167033 Jun 02 13:56:44.651877 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 167/345] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:44 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:45.667999 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-46b39869-7a3a-4de7-a72a-3b822cc55342 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:45.669259 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-46b39869-7a3a-4de7-a72a-3b822cc55342 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:45.676203 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-46b39869-7a3a-4de7-a72a-3b822cc55342 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:45.676678 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-46b39869-7a3a-4de7-a72a-3b822cc55342 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:45.677448 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-46b39869-7a3a-4de7-a72a-3b822cc55342 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:45.677879 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-46b39869-7a3a-4de7-a72a-3b822cc55342 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:45.810619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-46b39869-7a3a-4de7-a72a-3b822cc55342 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:45.818196 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-46b39869-7a3a-4de7-a72a-3b822cc55342 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.154121 Jun 02 13:56:45.818783 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 179/346] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:45 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:46.835141 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2284ef6e-6a4a-4121-be57-9bb1041210a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:46.835682 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-2284ef6e-6a4a-4121-be57-9bb1041210a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:46.838790 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=2 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:46.839486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=10 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:46.844560 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2284ef6e-6a4a-4121-be57-9bb1041210a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:46.845012 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2284ef6e-6a4a-4121-be57-9bb1041210a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:46.845771 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2284ef6e-6a4a-4121-be57-9bb1041210a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:46.846205 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2284ef6e-6a4a-4121-be57-9bb1041210a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:46.986219 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2284ef6e-6a4a-4121-be57-9bb1041210a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:46.993536 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2284ef6e-6a4a-4121-be57-9bb1041210a4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.162436 Jun 02 13:56:46.994088 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 168/347] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:46 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:48.010152 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4ce29fa9-7ded-403a-903f-ff35461d3baf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:48.010765 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4ce29fa9-7ded-403a-903f-ff35461d3baf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:48.012721 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=4 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:48.017629 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4ce29fa9-7ded-403a-903f-ff35461d3baf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:48.018075 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4ce29fa9-7ded-403a-903f-ff35461d3baf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:48.025165 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4ce29fa9-7ded-403a-903f-ff35461d3baf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:48.025165 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4ce29fa9-7ded-403a-903f-ff35461d3baf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:48.150090 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4ce29fa9-7ded-403a-903f-ff35461d3baf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:48.152279 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:48.158032 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4ce29fa9-7ded-403a-903f-ff35461d3baf tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.151740 Jun 02 13:56:48.158652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 180/348] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:48 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:49.175738 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-045cf75c-8139-4825-984c-91f1391d1bc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:49.176339 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-045cf75c-8139-4825-984c-91f1391d1bc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:49.183167 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-045cf75c-8139-4825-984c-91f1391d1bc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:49.183617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-045cf75c-8139-4825-984c-91f1391d1bc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:49.184376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-045cf75c-8139-4825-984c-91f1391d1bc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:49.184841 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-045cf75c-8139-4825-984c-91f1391d1bc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:49.323485 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-045cf75c-8139-4825-984c-91f1391d1bc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:49.332371 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-045cf75c-8139-4825-984c-91f1391d1bc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.160211 Jun 02 13:56:49.333049 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 169/349] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:49 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:50.350626 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8a51f713-d1ef-49b5-afde-1ed3bf539df0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:50.351404 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8a51f713-d1ef-49b5-afde-1ed3bf539df0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:50.358127 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8a51f713-d1ef-49b5-afde-1ed3bf539df0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:50.358647 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8a51f713-d1ef-49b5-afde-1ed3bf539df0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:50.359634 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8a51f713-d1ef-49b5-afde-1ed3bf539df0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:50.360067 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8a51f713-d1ef-49b5-afde-1ed3bf539df0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:50.500709 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8a51f713-d1ef-49b5-afde-1ed3bf539df0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:50.507845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8a51f713-d1ef-49b5-afde-1ed3bf539df0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.162490 Jun 02 13:56:50.508432 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 181/350] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:50 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:51.526079 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-68304313-3d1c-4756-ad77-0702216c9d20 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:51.526701 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-68304313-3d1c-4756-ad77-0702216c9d20 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:51.533554 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-68304313-3d1c-4756-ad77-0702216c9d20 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:51.534121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-68304313-3d1c-4756-ad77-0702216c9d20 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:51.534967 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-68304313-3d1c-4756-ad77-0702216c9d20 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:51.535503 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-68304313-3d1c-4756-ad77-0702216c9d20 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:51.682618 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-68304313-3d1c-4756-ad77-0702216c9d20 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:51.692120 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-68304313-3d1c-4756-ad77-0702216c9d20 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.170918 Jun 02 13:56:51.692730 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 170/351] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:51 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:52.710439 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-22733080-ae80-4062-abca-1e20e3fa7b75 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:52.711067 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-22733080-ae80-4062-abca-1e20e3fa7b75 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:52.717060 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-22733080-ae80-4062-abca-1e20e3fa7b75 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:52.717507 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-22733080-ae80-4062-abca-1e20e3fa7b75 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:52.718258 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-22733080-ae80-4062-abca-1e20e3fa7b75 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:52.718689 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-22733080-ae80-4062-abca-1e20e3fa7b75 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:52.854425 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-22733080-ae80-4062-abca-1e20e3fa7b75 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:52.863081 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-22733080-ae80-4062-abca-1e20e3fa7b75 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.156326 Jun 02 13:56:52.863715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 182/352] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:52 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:53.882829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-66800ed7-a880-454d-97c6-cba744086ffc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:53.884494 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-66800ed7-a880-454d-97c6-cba744086ffc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:53.891635 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-66800ed7-a880-454d-97c6-cba744086ffc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:53.892318 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-66800ed7-a880-454d-97c6-cba744086ffc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:53.893275 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-66800ed7-a880-454d-97c6-cba744086ffc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:53.893808 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-66800ed7-a880-454d-97c6-cba744086ffc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:54.031404 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-66800ed7-a880-454d-97c6-cba744086ffc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:54.039623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-66800ed7-a880-454d-97c6-cba744086ffc tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.161810 Jun 02 13:56:54.040332 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 171/353] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:53 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:56:55.056520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d1f94e54-0dad-4ed9-a792-a0a3546ed5c0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:55.057122 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d1f94e54-0dad-4ed9-a792-a0a3546ed5c0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:55.063183 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d1f94e54-0dad-4ed9-a792-a0a3546ed5c0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:55.063627 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d1f94e54-0dad-4ed9-a792-a0a3546ed5c0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:55.064380 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d1f94e54-0dad-4ed9-a792-a0a3546ed5c0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:55.064835 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d1f94e54-0dad-4ed9-a792-a0a3546ed5c0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:55.197827 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d1f94e54-0dad-4ed9-a792-a0a3546ed5c0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:55.204663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d1f94e54-0dad-4ed9-a792-a0a3546ed5c0 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.151930 Jun 02 13:56:55.205250 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 183/354] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:55 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:56.223764 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5f9a9e7a-e0b8-4fc7-9039-3a8685bf54f5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:56.224496 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5f9a9e7a-e0b8-4fc7-9039-3a8685bf54f5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:56.226883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:56.231705 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f9a9e7a-e0b8-4fc7-9039-3a8685bf54f5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:56.232151 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f9a9e7a-e0b8-4fc7-9039-3a8685bf54f5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:56.232949 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f9a9e7a-e0b8-4fc7-9039-3a8685bf54f5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:56.233384 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f9a9e7a-e0b8-4fc7-9039-3a8685bf54f5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:56.367514 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5f9a9e7a-e0b8-4fc7-9039-3a8685bf54f5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:56.375098 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5f9a9e7a-e0b8-4fc7-9039-3a8685bf54f5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.156643 Jun 02 13:56:56.375654 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 172/355] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:56 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:56.571875 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-50ed8406-1244-4b43-9f88-c8a8adbd71c7 req-3b3d0365-876a-4bf4-8494-18cd19e8a2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c714d190-39b3-40b8-a7d0-da49a06fe5fa", "name": "network-vif-plugged", "status": "completed", "tag": "49169967-d46d-4a7e-b861-a60a2de510d4"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:56:56.585527 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-50ed8406-1244-4b43-9f88-c8a8adbd71c7 req-3b3d0365-876a-4bf4-8494-18cd19e8a2ac service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:56.585707 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-50ed8406-1244-4b43-9f88-c8a8adbd71c7 req-3b3d0365-876a-4bf4-8494-18cd19e8a2ac service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:56.599017 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-50ed8406-1244-4b43-9f88-c8a8adbd71c7 req-3b3d0365-876a-4bf4-8494-18cd19e8a2ac service nova] Creating event network-vif-plugged:49169967-d46d-4a7e-b861-a60a2de510d4 for instance c714d190-39b3-40b8-a7d0-da49a06fe5fa on hv-cinder-82651 Jun 02 13:56:56.604060 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-50ed8406-1244-4b43-9f88-c8a8adbd71c7 req-3b3d0365-876a-4bf4-8494-18cd19e8a2ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036217 Jun 02 13:56:56.604683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 184/356] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:56:57.393005 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e21dc65c-61f2-4322-9fdf-f2e0918fc393 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:57.394259 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e21dc65c-61f2-4322-9fdf-f2e0918fc393 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:57.401021 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e21dc65c-61f2-4322-9fdf-f2e0918fc393 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:57.401465 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e21dc65c-61f2-4322-9fdf-f2e0918fc393 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:57.402209 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e21dc65c-61f2-4322-9fdf-f2e0918fc393 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:57.402637 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e21dc65c-61f2-4322-9fdf-f2e0918fc393 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:57.530592 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e21dc65c-61f2-4322-9fdf-f2e0918fc393 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:57.538126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e21dc65c-61f2-4322-9fdf-f2e0918fc393 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.149352 Jun 02 13:56:57.538685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 173/357] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:57 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:58.555406 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-324f6279-dcfe-4afe-8d3c-9a25f0d58c9f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:58.556091 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-324f6279-dcfe-4afe-8d3c-9a25f0d58c9f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:58.562243 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-324f6279-dcfe-4afe-8d3c-9a25f0d58c9f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:58.562677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-324f6279-dcfe-4afe-8d3c-9a25f0d58c9f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:58.563578 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-324f6279-dcfe-4afe-8d3c-9a25f0d58c9f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:58.564029 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-324f6279-dcfe-4afe-8d3c-9a25f0d58c9f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:58.698626 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-324f6279-dcfe-4afe-8d3c-9a25f0d58c9f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:58.707240 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-324f6279-dcfe-4afe-8d3c-9a25f0d58c9f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1368 microversion: 2.1 time: 0.155959 Jun 02 13:56:58.707821 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 185/358] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:58 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:59.725224 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2189256a-3bb8-483f-87be-886c633c19f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:59.725842 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-2189256a-3bb8-483f-87be-886c633c19f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:59.732634 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2189256a-3bb8-483f-87be-886c633c19f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:59.733179 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2189256a-3bb8-483f-87be-886c633c19f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:59.737584 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2189256a-3bb8-483f-87be-886c633c19f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:59.737584 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2189256a-3bb8-483f-87be-886c633c19f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:59.739210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=100 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:59.875165 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2189256a-3bb8-483f-87be-886c633c19f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:56:59.879623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2189256a-3bb8-483f-87be-886c633c19f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1561 microversion: 2.1 time: 0.159615 Jun 02 13:56:59.880343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 174/359] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:56:59 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:56:59.897456 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a6d56933-0cd6-47c9-84a6-49b87db5f4e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:56:59.898584 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a6d56933-0cd6-47c9-84a6-49b87db5f4e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:56:59.904876 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a6d56933-0cd6-47c9-84a6-49b87db5f4e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:59.905587 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a6d56933-0cd6-47c9-84a6-49b87db5f4e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:59.906419 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a6d56933-0cd6-47c9-84a6-49b87db5f4e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:56:59.907060 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a6d56933-0cd6-47c9-84a6-49b87db5f4e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:56:59.991974 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a6d56933-0cd6-47c9-84a6-49b87db5f4e8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098877 Jun 02 13:56:59.992588 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 186/360] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 2 13:56:59 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:57:01.000333 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-3ffd06ab-15d4-4396-b71f-c8fc01f3c0a3 req-56f3fa9f-d24f-493b-93a2-69d9e625cb01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c714d190-39b3-40b8-a7d0-da49a06fe5fa", "tag": "49169967-d46d-4a7e-b861-a60a2de510d4"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:57:01.012776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-3ffd06ab-15d4-4396-b71f-c8fc01f3c0a3 req-56f3fa9f-d24f-493b-93a2-69d9e625cb01 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:01.013228 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-3ffd06ab-15d4-4396-b71f-c8fc01f3c0a3 req-56f3fa9f-d24f-493b-93a2-69d9e625cb01 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:01.027552 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-3ffd06ab-15d4-4396-b71f-c8fc01f3c0a3 req-56f3fa9f-d24f-493b-93a2-69d9e625cb01 service nova] Creating event network-changed:49169967-d46d-4a7e-b861-a60a2de510d4 for instance c714d190-39b3-40b8-a7d0-da49a06fe5fa on hv-cinder-82651 Jun 02 13:57:01.031483 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-3ffd06ab-15d4-4396-b71f-c8fc01f3c0a3 req-56f3fa9f-d24f-493b-93a2-69d9e625cb01 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034722 Jun 02 13:57:01.032150 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 175/361] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:57:34.638913 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=37 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:34.640144 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=31 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:34.644625 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1823472306", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1654500253", "security_groups": [{"name": "tempest-secgroup-smoke-1839129216"}], "networks": [{"uuid": "9d975663-4d10-4846-a43d-03fb52392e1d"}], "block_device_mapping_v2": [{"uuid": "297bb6b1-201b-4fc5-94d9-195958556efe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:57:34.780392 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=7 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:34.781781 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=6 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:34.787111 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-269009452", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1891088145", "security_groups": [{"name": "tempest-secgroup-smoke-995264798"}], "block_device_mapping_v2": [{"uuid": "580c5bdb-e969-4779-b3b5-00c78d8a8ee0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "86c95916-f1de-4921-b403-dd7a25eabe5a"}]}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:57:34.794929 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.network.neutron [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] validate_networks() for [('9d975663-4d10-4846-a43d-03fb52392e1d', None, None, None, None, None)] {{(pid=118316) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:57:35.143047 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.network.neutron [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] validate_networks() for [('86c95916-f1de-4921-b403-dd7a25eabe5a', None, None, None, None, None)] {{(pid=118315) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:57:35.639058 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Flavor limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:57:35.639571 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Image limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:57:35.643986 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Flavor pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:57:35.644342 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Image pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:57:35.644785 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:57:35.654673 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:35.655244 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:35.656173 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:35.656743 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:35.675012 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Getting quotas for project c5c02b70c6fa4d4b999cca3d9f6154c5. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:57:35.679387 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Getting quotas for user 198160f6a7524bbb9f90798d2269db00 and project c5c02b70c6fa4d4b999cca3d9f6154c5. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:57:35.751398 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Going to run 1 instances... {{(pid=118316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:57:35.751398 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='297bb6b1-201b-4fc5-94d9-195958556efe',volume_size=None,volume_type=None)] {{(pid=118316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:57:35.751933 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Flavor limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:57:35.751933 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Image limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:57:35.751933 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Flavor pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:57:35.751933 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Image pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:57:35.751933 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:57:35.761052 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:35.761619 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:35.762698 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:35.763208 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:35.782171 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Getting quotas for project b55a34a53b2740d9af5efd660424a456. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:57:35.787298 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Getting quotas for user 315c0d9d9a284389ae07bf898c330605 and project b55a34a53b2740d9af5efd660424a456. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:57:35.945628 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Going to run 1 instances... {{(pid=118315) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:57:35.947909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='580c5bdb-e969-4779-b3b5-00c78d8a8ee0',volume_size=None,volume_type=None)] {{(pid=118315) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:57:36.260492 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-069c67fa-9973-4c84-9d20-a5dc033cd46a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.622370 Jun 02 13:57:36.266351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 187/362] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 13:57:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:57:36.271864 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3e72bccd-fca2-4b4b-8dd5-a46f13c57d62 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:36.274737 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3e72bccd-fca2-4b4b-8dd5-a46f13c57d62 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:36.327004 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3e72bccd-fca2-4b4b-8dd5-a46f13c57d62 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:36.335179 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3e72bccd-fca2-4b4b-8dd5-a46f13c57d62 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1089 microversion: 2.1 time: 0.067659 Jun 02 13:57:36.335739 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 188/363] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:36 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:57:36.491608 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-8b3c9144-03aa-4cb9-b338-b0b330635b84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.712666 Jun 02 13:57:36.492489 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 176/364] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 13:57:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:57:36.506986 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6c6df881-6ac7-4e9b-ba2b-bd4032d397fb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:36.507704 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6c6df881-6ac7-4e9b-ba2b-bd4032d397fb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:36.565349 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6c6df881-6ac7-4e9b-ba2b-bd4032d397fb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:36.572878 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6c6df881-6ac7-4e9b-ba2b-bd4032d397fb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1094 microversion: 2.1 time: 0.074318 Jun 02 13:57:36.573668 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 189/365] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:36 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:37.353269 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f709a40e-2e3c-42ed-a47a-824163f623af tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:37.353846 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f709a40e-2e3c-42ed-a47a-824163f623af tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:37.411588 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f709a40e-2e3c-42ed-a47a-824163f623af tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:37.418182 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f709a40e-2e3c-42ed-a47a-824163f623af tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1089 microversion: 2.1 time: 0.069712 Jun 02 13:57:37.418739 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 177/366] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:37 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:37.590405 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e6f83334-1480-4566-9335-8f7d4e993e6f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:37.591023 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e6f83334-1480-4566-9335-8f7d4e993e6f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:37.597226 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6f83334-1480-4566-9335-8f7d4e993e6f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:37.597676 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6f83334-1480-4566-9335-8f7d4e993e6f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:37.598950 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6f83334-1480-4566-9335-8f7d4e993e6f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:37.599383 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6f83334-1480-4566-9335-8f7d4e993e6f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:37.662234 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e6f83334-1480-4566-9335-8f7d4e993e6f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:37.669778 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e6f83334-1480-4566-9335-8f7d4e993e6f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1144 microversion: 2.1 time: 0.083330 Jun 02 13:57:37.671407 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 190/367] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:37 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:38.434714 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5b4cd337-ab43-4f42-8bb8-dd58064da0cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:38.435325 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5b4cd337-ab43-4f42-8bb8-dd58064da0cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:38.443112 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5b4cd337-ab43-4f42-8bb8-dd58064da0cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:38.443565 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5b4cd337-ab43-4f42-8bb8-dd58064da0cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:38.444613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5b4cd337-ab43-4f42-8bb8-dd58064da0cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:38.445055 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5b4cd337-ab43-4f42-8bb8-dd58064da0cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:38.506779 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5b4cd337-ab43-4f42-8bb8-dd58064da0cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:38.514382 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5b4cd337-ab43-4f42-8bb8-dd58064da0cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1131 microversion: 2.1 time: 0.083523 Jun 02 13:57:38.514948 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 178/368] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:38 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1131 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:38.687381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8f566ec1-2280-41f3-ae0e-2aa08c2a138f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:38.688034 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8f566ec1-2280-41f3-ae0e-2aa08c2a138f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:38.694110 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8f566ec1-2280-41f3-ae0e-2aa08c2a138f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:38.694550 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8f566ec1-2280-41f3-ae0e-2aa08c2a138f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:38.695324 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8f566ec1-2280-41f3-ae0e-2aa08c2a138f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:38.695748 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8f566ec1-2280-41f3-ae0e-2aa08c2a138f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:38.755382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8f566ec1-2280-41f3-ae0e-2aa08c2a138f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:38.762649 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8f566ec1-2280-41f3-ae0e-2aa08c2a138f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1144 microversion: 2.1 time: 0.079117 Jun 02 13:57:38.763237 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 191/369] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:38 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1144 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:39.531938 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f2331626-5024-40a3-9d61-e07ed80b6a0b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:39.532583 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f2331626-5024-40a3-9d61-e07ed80b6a0b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:39.539045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f2331626-5024-40a3-9d61-e07ed80b6a0b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:39.539494 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f2331626-5024-40a3-9d61-e07ed80b6a0b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:39.540252 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f2331626-5024-40a3-9d61-e07ed80b6a0b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:39.540715 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f2331626-5024-40a3-9d61-e07ed80b6a0b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:39.602883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f2331626-5024-40a3-9d61-e07ed80b6a0b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:39.610174 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f2331626-5024-40a3-9d61-e07ed80b6a0b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1131 microversion: 2.1 time: 0.082065 Jun 02 13:57:39.610737 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 179/370] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:39 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1131 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:39.780057 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a367c947-1230-4ece-8751-2adb83dfc371 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:39.780769 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a367c947-1230-4ece-8751-2adb83dfc371 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:39.787182 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a367c947-1230-4ece-8751-2adb83dfc371 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:39.787625 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a367c947-1230-4ece-8751-2adb83dfc371 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:39.790919 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a367c947-1230-4ece-8751-2adb83dfc371 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:39.790919 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a367c947-1230-4ece-8751-2adb83dfc371 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:39.849219 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a367c947-1230-4ece-8751-2adb83dfc371 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:39.856764 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a367c947-1230-4ece-8751-2adb83dfc371 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1144 microversion: 2.1 time: 0.080478 Jun 02 13:57:39.857263 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 192/371] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:39 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:40.626981 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-65b83e36-dc05-43c6-a507-bc39401b74e0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:40.627587 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-65b83e36-dc05-43c6-a507-bc39401b74e0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:40.635022 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-65b83e36-dc05-43c6-a507-bc39401b74e0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:40.635490 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-65b83e36-dc05-43c6-a507-bc39401b74e0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:40.636234 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-65b83e36-dc05-43c6-a507-bc39401b74e0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:40.636683 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-65b83e36-dc05-43c6-a507-bc39401b74e0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:40.696086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-65b83e36-dc05-43c6-a507-bc39401b74e0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:40.703587 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-65b83e36-dc05-43c6-a507-bc39401b74e0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1131 microversion: 2.1 time: 0.080470 Jun 02 13:57:40.704135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 180/372] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:40 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1131 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:40.874159 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7db3154e-4e5a-46ee-b287-c3f0095be1c5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:40.874793 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7db3154e-4e5a-46ee-b287-c3f0095be1c5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:40.881424 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7db3154e-4e5a-46ee-b287-c3f0095be1c5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:40.881858 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7db3154e-4e5a-46ee-b287-c3f0095be1c5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:40.882593 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7db3154e-4e5a-46ee-b287-c3f0095be1c5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:40.883037 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7db3154e-4e5a-46ee-b287-c3f0095be1c5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:40.941428 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7db3154e-4e5a-46ee-b287-c3f0095be1c5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:40.949400 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7db3154e-4e5a-46ee-b287-c3f0095be1c5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1136 microversion: 2.1 time: 0.079134 Jun 02 13:57:40.950265 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 193/373] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:40 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1136 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:41.720942 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-bdcbcdbc-0cbb-43b4-b427-208a623d59e2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:41.721455 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-bdcbcdbc-0cbb-43b4-b427-208a623d59e2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:41.728550 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bdcbcdbc-0cbb-43b4-b427-208a623d59e2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:41.729017 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bdcbcdbc-0cbb-43b4-b427-208a623d59e2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:41.729790 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bdcbcdbc-0cbb-43b4-b427-208a623d59e2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:41.730213 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bdcbcdbc-0cbb-43b4-b427-208a623d59e2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:41.804015 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-bdcbcdbc-0cbb-43b4-b427-208a623d59e2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:41.812137 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-bdcbcdbc-0cbb-43b4-b427-208a623d59e2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1187 microversion: 2.1 time: 0.095151 Jun 02 13:57:41.812910 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 181/374] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:41 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:41.966951 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-1719aaf0-dd59-49c6-899a-47bfbc24c15c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:41.967557 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-1719aaf0-dd59-49c6-899a-47bfbc24c15c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:41.974136 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1719aaf0-dd59-49c6-899a-47bfbc24c15c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:41.974492 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1719aaf0-dd59-49c6-899a-47bfbc24c15c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:41.975260 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1719aaf0-dd59-49c6-899a-47bfbc24c15c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:41.975686 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1719aaf0-dd59-49c6-899a-47bfbc24c15c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:42.037624 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1719aaf0-dd59-49c6-899a-47bfbc24c15c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:42.045088 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-1719aaf0-dd59-49c6-899a-47bfbc24c15c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1192 microversion: 2.1 time: 0.082148 Jun 02 13:57:42.045765 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 194/375] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:41 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:42.831559 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-533cc010-b787-42da-aafb-154c04a221d9 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:42.832149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-533cc010-b787-42da-aafb-154c04a221d9 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:42.839325 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-533cc010-b787-42da-aafb-154c04a221d9 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:42.839762 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-533cc010-b787-42da-aafb-154c04a221d9 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:42.840584 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-533cc010-b787-42da-aafb-154c04a221d9 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:42.841011 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-533cc010-b787-42da-aafb-154c04a221d9 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:42.918604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-533cc010-b787-42da-aafb-154c04a221d9 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:42.926135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-533cc010-b787-42da-aafb-154c04a221d9 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1195 microversion: 2.1 time: 0.098501 Jun 02 13:57:42.926683 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 182/376] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:42 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1195 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:42.963385 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2de63aeb-3e4a-4884-90e7-71f06d9bb08f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:42.963885 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2de63aeb-3e4a-4884-90e7-71f06d9bb08f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:42.969815 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2de63aeb-3e4a-4884-90e7-71f06d9bb08f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:42.970426 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2de63aeb-3e4a-4884-90e7-71f06d9bb08f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:42.971012 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2de63aeb-3e4a-4884-90e7-71f06d9bb08f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:42.971442 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2de63aeb-3e4a-4884-90e7-71f06d9bb08f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:42.994790 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2de63aeb-3e4a-4884-90e7-71f06d9bb08f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/ips" status: 200 len: 152 microversion: 2.20 time: 0.035264 Jun 02 13:57:42.995540 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 195/377] 10.222.0.33 () {60 vars in 1288 bytes} [Thu Jun 2 13:57:42 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:57:43.062200 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c173744d-267f-4aa3-a90c-3bc21863ca5f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:43.063511 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c173744d-267f-4aa3-a90c-3bc21863ca5f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:43.076304 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c173744d-267f-4aa3-a90c-3bc21863ca5f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:43.081892 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c173744d-267f-4aa3-a90c-3bc21863ca5f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:43.084451 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c173744d-267f-4aa3-a90c-3bc21863ca5f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:43.086887 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c173744d-267f-4aa3-a90c-3bc21863ca5f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:43.159553 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c173744d-267f-4aa3-a90c-3bc21863ca5f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:43.167806 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c173744d-267f-4aa3-a90c-3bc21863ca5f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1200 microversion: 2.1 time: 0.109549 Jun 02 13:57:43.168592 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 183/378] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:43 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1200 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:43.952742 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e66b2bf6-c2d0-403e-80e1-16f5890ddd98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:43.953363 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e66b2bf6-c2d0-403e-80e1-16f5890ddd98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:43.969739 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e66b2bf6-c2d0-403e-80e1-16f5890ddd98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:43.971924 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e66b2bf6-c2d0-403e-80e1-16f5890ddd98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:43.975282 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e66b2bf6-c2d0-403e-80e1-16f5890ddd98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:43.977458 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e66b2bf6-c2d0-403e-80e1-16f5890ddd98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:44.070121 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e66b2bf6-c2d0-403e-80e1-16f5890ddd98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:44.084241 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e66b2bf6-c2d0-403e-80e1-16f5890ddd98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1205 microversion: 2.1 time: 0.134148 Jun 02 13:57:44.084241 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 196/379] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:43 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1205 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:44.186344 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-bc97a692-0e12-471b-b1a5-c21db56fac93 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:44.187116 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-bc97a692-0e12-471b-b1a5-c21db56fac93 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:44.194742 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bc97a692-0e12-471b-b1a5-c21db56fac93 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:44.195265 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bc97a692-0e12-471b-b1a5-c21db56fac93 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:44.196237 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bc97a692-0e12-471b-b1a5-c21db56fac93 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:44.196704 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bc97a692-0e12-471b-b1a5-c21db56fac93 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:44.273489 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-bc97a692-0e12-471b-b1a5-c21db56fac93 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:44.284002 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-bc97a692-0e12-471b-b1a5-c21db56fac93 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1210 microversion: 2.1 time: 0.101441 Jun 02 13:57:44.284746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 184/380] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:44 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:45.100661 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e6d8064b-f941-4960-a7b0-3e3f8121f230 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:45.101846 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e6d8064b-f941-4960-a7b0-3e3f8121f230 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:45.108266 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6d8064b-f941-4960-a7b0-3e3f8121f230 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:45.108955 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6d8064b-f941-4960-a7b0-3e3f8121f230 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:45.109914 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6d8064b-f941-4960-a7b0-3e3f8121f230 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:45.110520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6d8064b-f941-4960-a7b0-3e3f8121f230 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:45.246529 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e6d8064b-f941-4960-a7b0-3e3f8121f230 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:45.256047 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e6d8064b-f941-4960-a7b0-3e3f8121f230 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1273 microversion: 2.1 time: 0.159855 Jun 02 13:57:45.256972 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 197/381] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:45 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:45.301494 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-43c6cceb-fc73-4c64-bfe3-fae6e3648d08 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:45.302231 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-43c6cceb-fc73-4c64-bfe3-fae6e3648d08 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:45.308730 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-43c6cceb-fc73-4c64-bfe3-fae6e3648d08 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:45.309182 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-43c6cceb-fc73-4c64-bfe3-fae6e3648d08 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:45.309948 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-43c6cceb-fc73-4c64-bfe3-fae6e3648d08 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:45.310382 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-43c6cceb-fc73-4c64-bfe3-fae6e3648d08 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:45.454074 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-43c6cceb-fc73-4c64-bfe3-fae6e3648d08 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:45.467328 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-43c6cceb-fc73-4c64-bfe3-fae6e3648d08 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1277 microversion: 2.1 time: 0.169463 Jun 02 13:57:45.468618 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 185/382] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:45 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:57:45.938700 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-d3331caf-a325-4e2f-8e6e-1ccfb15b1d02 req-33813a5d-b7c4-4f5f-aa9e-6a9682f9f78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4253a95d-5443-4a20-9a10-621c058e8674", "tag": "7e76fdd4-e430-47ed-aee9-504128683d44"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:57:45.948809 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:45.951400 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-d3331caf-a325-4e2f-8e6e-1ccfb15b1d02 req-33813a5d-b7c4-4f5f-aa9e-6a9682f9f78b service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:45.952019 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-d3331caf-a325-4e2f-8e6e-1ccfb15b1d02 req-33813a5d-b7c4-4f5f-aa9e-6a9682f9f78b service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:45.968308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-d3331caf-a325-4e2f-8e6e-1ccfb15b1d02 req-33813a5d-b7c4-4f5f-aa9e-6a9682f9f78b service nova] Creating event network-changed:7e76fdd4-e430-47ed-aee9-504128683d44 for instance 4253a95d-5443-4a20-9a10-621c058e8674 on hv-cinder-82651 Jun 02 13:57:45.976596 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-d3331caf-a325-4e2f-8e6e-1ccfb15b1d02 req-33813a5d-b7c4-4f5f-aa9e-6a9682f9f78b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041723 Jun 02 13:57:45.977686 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 198/383] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:57:46.273285 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-cf50fffa-3cf9-438d-a820-cc3c0acf0bfe tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:46.273906 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-cf50fffa-3cf9-438d-a820-cc3c0acf0bfe tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:46.276116 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=2 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:46.281517 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cf50fffa-3cf9-438d-a820-cc3c0acf0bfe tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:46.281708 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cf50fffa-3cf9-438d-a820-cc3c0acf0bfe tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:46.282697 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cf50fffa-3cf9-438d-a820-cc3c0acf0bfe tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:46.283343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cf50fffa-3cf9-438d-a820-cc3c0acf0bfe tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:46.439323 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-cf50fffa-3cf9-438d-a820-cc3c0acf0bfe tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:46.447729 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-cf50fffa-3cf9-438d-a820-cc3c0acf0bfe tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1273 microversion: 2.1 time: 0.179328 Jun 02 13:57:46.448554 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 186/384] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:46 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:46.486762 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a62c3887-9d78-4ef8-85fe-f469bcb0223c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:46.487715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a62c3887-9d78-4ef8-85fe-f469bcb0223c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:46.495142 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a62c3887-9d78-4ef8-85fe-f469bcb0223c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:46.496307 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a62c3887-9d78-4ef8-85fe-f469bcb0223c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:46.497364 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a62c3887-9d78-4ef8-85fe-f469bcb0223c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:46.497980 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a62c3887-9d78-4ef8-85fe-f469bcb0223c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:46.531099 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-06e1f263-900c-4edf-bd69-a26348840b2c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:57:46.533238 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-06e1f263-900c-4edf-bd69-a26348840b2c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:46.546963 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-06e1f263-900c-4edf-bd69-a26348840b2c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:46.547613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-06e1f263-900c-4edf-bd69-a26348840b2c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:46.548616 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-06e1f263-900c-4edf-bd69-a26348840b2c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:46.549642 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-06e1f263-900c-4edf-bd69-a26348840b2c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:46.570054 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=10 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:46.586761 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-06e1f263-900c-4edf-bd69-a26348840b2c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lazy-loading 'flavor' on Instance uuid 83d462ae-af14-4d5d-aab2-f45954429480 {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:57:46.659940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a62c3887-9d78-4ef8-85fe-f469bcb0223c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:46.668613 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a62c3887-9d78-4ef8-85fe-f469bcb0223c tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1277 microversion: 2.1 time: 0.186563 Jun 02 13:57:46.669189 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 199/385] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:46 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:47.200595 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-06e1f263-900c-4edf-bd69-a26348840b2c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "POST /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/action" status: 202 len: 0 microversion: 2.20 time: 0.683978 Jun 02 13:57:47.201383 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 187/386] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 2 13:57:46 2022] POST /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:57:47.209849 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4828e159-6a2c-4cab-81d0-c5743671cf80 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:47.210470 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4828e159-6a2c-4cab-81d0-c5743671cf80 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:47.216537 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4828e159-6a2c-4cab-81d0-c5743671cf80 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:47.216985 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4828e159-6a2c-4cab-81d0-c5743671cf80 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:47.217740 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4828e159-6a2c-4cab-81d0-c5743671cf80 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:47.218171 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4828e159-6a2c-4cab-81d0-c5743671cf80 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:47.355231 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4828e159-6a2c-4cab-81d0-c5743671cf80 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:47.363239 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4828e159-6a2c-4cab-81d0-c5743671cf80 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:47.364786 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4828e159-6a2c-4cab-81d0-c5743671cf80 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:47.365933 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4828e159-6a2c-4cab-81d0-c5743671cf80 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.160450 Jun 02 13:57:47.366487 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 200/387] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:57:47 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:57:47.464421 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=8 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:47.468990 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-34a40fbd-284b-4154-be3c-06469d1236ae tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:47.471874 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-34a40fbd-284b-4154-be3c-06469d1236ae tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:47.476425 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-34a40fbd-284b-4154-be3c-06469d1236ae tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:47.477022 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-34a40fbd-284b-4154-be3c-06469d1236ae tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:47.477787 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-34a40fbd-284b-4154-be3c-06469d1236ae tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:47.478224 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-34a40fbd-284b-4154-be3c-06469d1236ae tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:47.610057 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-34a40fbd-284b-4154-be3c-06469d1236ae tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:47.618309 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-34a40fbd-284b-4154-be3c-06469d1236ae tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.155348 Jun 02 13:57:47.618940 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 188/388] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:47 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:47.685657 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c6dbdf8a-9740-4914-865e-4860d2adde0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:47.686268 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c6dbdf8a-9740-4914-865e-4860d2adde0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:47.693206 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6dbdf8a-9740-4914-865e-4860d2adde0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:47.693650 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6dbdf8a-9740-4914-865e-4860d2adde0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:47.694408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6dbdf8a-9740-4914-865e-4860d2adde0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:47.694839 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6dbdf8a-9740-4914-865e-4860d2adde0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:47.839111 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c6dbdf8a-9740-4914-865e-4860d2adde0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:47.846881 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c6dbdf8a-9740-4914-865e-4860d2adde0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1277 microversion: 2.1 time: 0.165350 Jun 02 13:57:47.847458 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 201/389] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:47 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:48.011839 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-ce49e7cc-3ec4-4477-9784-103cf971b258 req-b80aacd7-ffa3-4710-9260-d075167ed1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff8b777-591b-48fc-8e08-8722d8a3adca", "tag": "5161504c-7de3-4d83-8150-813b7b219462"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:57:48.019749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-ce49e7cc-3ec4-4477-9784-103cf971b258 req-b80aacd7-ffa3-4710-9260-d075167ed1b2 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:48.020929 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-ce49e7cc-3ec4-4477-9784-103cf971b258 req-b80aacd7-ffa3-4710-9260-d075167ed1b2 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:48.033657 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-ce49e7cc-3ec4-4477-9784-103cf971b258 req-b80aacd7-ffa3-4710-9260-d075167ed1b2 service nova] Creating event network-changed:5161504c-7de3-4d83-8150-813b7b219462 for instance 6ff8b777-591b-48fc-8e08-8722d8a3adca on hv-cinder-82651 Jun 02 13:57:48.038518 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-ce49e7cc-3ec4-4477-9784-103cf971b258 req-b80aacd7-ffa3-4710-9260-d075167ed1b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030373 Jun 02 13:57:48.039096 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 189/390] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:57:48.385709 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-fedefbb1-397c-4a6a-a4dc-22b1f0eab020 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:48.386235 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-fedefbb1-397c-4a6a-a4dc-22b1f0eab020 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:48.392186 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fedefbb1-397c-4a6a-a4dc-22b1f0eab020 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:48.392665 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fedefbb1-397c-4a6a-a4dc-22b1f0eab020 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:48.393411 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fedefbb1-397c-4a6a-a4dc-22b1f0eab020 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:48.393841 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fedefbb1-397c-4a6a-a4dc-22b1f0eab020 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:48.522022 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-fedefbb1-397c-4a6a-a4dc-22b1f0eab020 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:48.530154 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-fedefbb1-397c-4a6a-a4dc-22b1f0eab020 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:48.531670 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-fedefbb1-397c-4a6a-a4dc-22b1f0eab020 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:48.532850 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-fedefbb1-397c-4a6a-a4dc-22b1f0eab020 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.151160 Jun 02 13:57:48.533412 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 202/391] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:57:48 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:57:48.638884 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ce9f75f6-5a44-4b2d-bf84-1022950e4a00 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:48.638884 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ce9f75f6-5a44-4b2d-bf84-1022950e4a00 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:48.644061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ce9f75f6-5a44-4b2d-bf84-1022950e4a00 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:48.644529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ce9f75f6-5a44-4b2d-bf84-1022950e4a00 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:48.645355 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ce9f75f6-5a44-4b2d-bf84-1022950e4a00 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:48.645925 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ce9f75f6-5a44-4b2d-bf84-1022950e4a00 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:48.777634 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ce9f75f6-5a44-4b2d-bf84-1022950e4a00 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:48.785879 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ce9f75f6-5a44-4b2d-bf84-1022950e4a00 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.153264 Jun 02 13:57:48.786666 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 190/392] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:48 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:48.867131 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-488ff6d0-e549-444c-a495-942976e3fbb9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:48.867773 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-488ff6d0-e549-444c-a495-942976e3fbb9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:48.874164 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-488ff6d0-e549-444c-a495-942976e3fbb9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:48.874666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-488ff6d0-e549-444c-a495-942976e3fbb9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:48.875491 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-488ff6d0-e549-444c-a495-942976e3fbb9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:48.875920 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-488ff6d0-e549-444c-a495-942976e3fbb9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:49.012639 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-488ff6d0-e549-444c-a495-942976e3fbb9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:49.021116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-488ff6d0-e549-444c-a495-942976e3fbb9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1277 microversion: 2.1 time: 0.159325 Jun 02 13:57:49.021814 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 203/393] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:48 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:49.552060 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b7d724a7-f130-4524-b884-f57f5a261ddf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:49.552695 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b7d724a7-f130-4524-b884-f57f5a261ddf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:49.558717 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7d724a7-f130-4524-b884-f57f5a261ddf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:49.559159 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7d724a7-f130-4524-b884-f57f5a261ddf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:49.559920 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7d724a7-f130-4524-b884-f57f5a261ddf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:49.560352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7d724a7-f130-4524-b884-f57f5a261ddf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:49.689371 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b7d724a7-f130-4524-b884-f57f5a261ddf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:49.698455 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b7d724a7-f130-4524-b884-f57f5a261ddf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:49.700482 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b7d724a7-f130-4524-b884-f57f5a261ddf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:49.702742 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b7d724a7-f130-4524-b884-f57f5a261ddf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.154325 Jun 02 13:57:49.702742 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 191/394] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:57:49 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:57:49.803387 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2ff06b2c-8e36-426d-9443-b0a7be3a0f71 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:49.803994 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2ff06b2c-8e36-426d-9443-b0a7be3a0f71 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:49.809993 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2ff06b2c-8e36-426d-9443-b0a7be3a0f71 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:49.810444 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2ff06b2c-8e36-426d-9443-b0a7be3a0f71 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:49.811193 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2ff06b2c-8e36-426d-9443-b0a7be3a0f71 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:49.811626 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2ff06b2c-8e36-426d-9443-b0a7be3a0f71 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:49.954703 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2ff06b2c-8e36-426d-9443-b0a7be3a0f71 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:49.963068 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2ff06b2c-8e36-426d-9443-b0a7be3a0f71 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.164332 Jun 02 13:57:49.964304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 204/395] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:49 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:50.039285 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b8bd4a95-90b3-4f39-b47c-1998d4e22309 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:50.039938 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b8bd4a95-90b3-4f39-b47c-1998d4e22309 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:50.046159 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8bd4a95-90b3-4f39-b47c-1998d4e22309 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:50.046611 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8bd4a95-90b3-4f39-b47c-1998d4e22309 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:50.047373 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8bd4a95-90b3-4f39-b47c-1998d4e22309 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:50.047810 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8bd4a95-90b3-4f39-b47c-1998d4e22309 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:50.179458 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b8bd4a95-90b3-4f39-b47c-1998d4e22309 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:50.183095 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:50.187772 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b8bd4a95-90b3-4f39-b47c-1998d4e22309 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.153721 Jun 02 13:57:50.188337 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 192/396] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:50 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:50.719901 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-55d3c549-e43e-4dab-836d-fa5d7f5d19f1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:50.720655 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-55d3c549-e43e-4dab-836d-fa5d7f5d19f1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:50.727216 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-55d3c549-e43e-4dab-836d-fa5d7f5d19f1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:50.727663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-55d3c549-e43e-4dab-836d-fa5d7f5d19f1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:50.728426 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-55d3c549-e43e-4dab-836d-fa5d7f5d19f1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:50.728906 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-55d3c549-e43e-4dab-836d-fa5d7f5d19f1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:50.857818 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-55d3c549-e43e-4dab-836d-fa5d7f5d19f1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:50.866678 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-55d3c549-e43e-4dab-836d-fa5d7f5d19f1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:50.868447 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-55d3c549-e43e-4dab-836d-fa5d7f5d19f1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:50.869601 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-55d3c549-e43e-4dab-836d-fa5d7f5d19f1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.153615 Jun 02 13:57:50.870154 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 205/397] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:57:50 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:57:50.982313 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5191718d-a4f4-4eb1-97c7-28f9affd7cb5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:50.982919 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5191718d-a4f4-4eb1-97c7-28f9affd7cb5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:50.989702 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5191718d-a4f4-4eb1-97c7-28f9affd7cb5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:50.990146 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5191718d-a4f4-4eb1-97c7-28f9affd7cb5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:50.991642 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5191718d-a4f4-4eb1-97c7-28f9affd7cb5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:50.992071 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5191718d-a4f4-4eb1-97c7-28f9affd7cb5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:51.174745 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5191718d-a4f4-4eb1-97c7-28f9affd7cb5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:51.183085 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5191718d-a4f4-4eb1-97c7-28f9affd7cb5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.205213 Jun 02 13:57:51.183664 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 193/398] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:50 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:51.205945 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e4c8f773-c362-487e-af0b-3dd74ea185c4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:51.206848 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e4c8f773-c362-487e-af0b-3dd74ea185c4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:51.213351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e4c8f773-c362-487e-af0b-3dd74ea185c4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:51.213792 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e4c8f773-c362-487e-af0b-3dd74ea185c4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:51.214575 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e4c8f773-c362-487e-af0b-3dd74ea185c4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:51.214997 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e4c8f773-c362-487e-af0b-3dd74ea185c4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:51.389538 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e4c8f773-c362-487e-af0b-3dd74ea185c4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:51.397456 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e4c8f773-c362-487e-af0b-3dd74ea185c4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.195390 Jun 02 13:57:51.398022 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 206/399] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:51 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:51.897849 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5ec31f81-fad8-4b0e-a5a7-6726d3c97a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:51.898418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5ec31f81-fad8-4b0e-a5a7-6726d3c97a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:51.904354 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5ec31f81-fad8-4b0e-a5a7-6726d3c97a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:51.904826 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5ec31f81-fad8-4b0e-a5a7-6726d3c97a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:51.905583 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5ec31f81-fad8-4b0e-a5a7-6726d3c97a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:51.906002 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5ec31f81-fad8-4b0e-a5a7-6726d3c97a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:52.042804 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5ec31f81-fad8-4b0e-a5a7-6726d3c97a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:52.046256 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5ec31f81-fad8-4b0e-a5a7-6726d3c97a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:52.047780 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5ec31f81-fad8-4b0e-a5a7-6726d3c97a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:52.049052 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5ec31f81-fad8-4b0e-a5a7-6726d3c97a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.157131 Jun 02 13:57:52.049617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 194/400] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:57:51 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:57:52.202001 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a68f97c5-abd8-426c-be66-1b0fb401c6cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:52.202659 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a68f97c5-abd8-426c-be66-1b0fb401c6cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:52.210094 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a68f97c5-abd8-426c-be66-1b0fb401c6cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:52.210656 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a68f97c5-abd8-426c-be66-1b0fb401c6cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:52.211298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a68f97c5-abd8-426c-be66-1b0fb401c6cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:52.211730 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a68f97c5-abd8-426c-be66-1b0fb401c6cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:52.216924 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:52.344070 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a68f97c5-abd8-426c-be66-1b0fb401c6cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:52.351802 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a68f97c5-abd8-426c-be66-1b0fb401c6cf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.155083 Jun 02 13:57:52.352363 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 207/401] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:52 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:52.414806 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3b611104-749e-4806-9c57-10a59d94b3a6 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:52.415401 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3b611104-749e-4806-9c57-10a59d94b3a6 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:52.421407 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3b611104-749e-4806-9c57-10a59d94b3a6 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:52.421868 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3b611104-749e-4806-9c57-10a59d94b3a6 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:52.422609 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3b611104-749e-4806-9c57-10a59d94b3a6 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:52.423044 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3b611104-749e-4806-9c57-10a59d94b3a6 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:52.563203 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3b611104-749e-4806-9c57-10a59d94b3a6 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:52.571730 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3b611104-749e-4806-9c57-10a59d94b3a6 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.161444 Jun 02 13:57:52.572302 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 195/402] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:52 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:53.067232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b186db0e-e95f-4e12-b7df-eb8bcdaa4413 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:53.067854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b186db0e-e95f-4e12-b7df-eb8bcdaa4413 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:53.074819 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b186db0e-e95f-4e12-b7df-eb8bcdaa4413 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:53.075268 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b186db0e-e95f-4e12-b7df-eb8bcdaa4413 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:53.076028 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b186db0e-e95f-4e12-b7df-eb8bcdaa4413 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:53.076477 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b186db0e-e95f-4e12-b7df-eb8bcdaa4413 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:53.212160 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b186db0e-e95f-4e12-b7df-eb8bcdaa4413 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:53.222539 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b186db0e-e95f-4e12-b7df-eb8bcdaa4413 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:53.224349 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b186db0e-e95f-4e12-b7df-eb8bcdaa4413 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:53.226183 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b186db0e-e95f-4e12-b7df-eb8bcdaa4413 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.162957 Jun 02 13:57:53.226852 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 208/403] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:57:53 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:57:53.369416 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-924d6f15-b8b9-44aa-9afe-ef9b9a627558 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:53.370141 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-924d6f15-b8b9-44aa-9afe-ef9b9a627558 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:53.376741 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-924d6f15-b8b9-44aa-9afe-ef9b9a627558 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:53.377190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-924d6f15-b8b9-44aa-9afe-ef9b9a627558 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:53.377958 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-924d6f15-b8b9-44aa-9afe-ef9b9a627558 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:53.378390 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-924d6f15-b8b9-44aa-9afe-ef9b9a627558 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:53.516973 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-924d6f15-b8b9-44aa-9afe-ef9b9a627558 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:53.525395 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-924d6f15-b8b9-44aa-9afe-ef9b9a627558 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.160563 Jun 02 13:57:53.526039 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 196/404] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:53 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:53.589773 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0ea7d025-695c-4f2c-80b8-02cb392e8c09 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:53.590375 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0ea7d025-695c-4f2c-80b8-02cb392e8c09 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:53.596227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ea7d025-695c-4f2c-80b8-02cb392e8c09 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:53.596689 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ea7d025-695c-4f2c-80b8-02cb392e8c09 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:53.597432 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ea7d025-695c-4f2c-80b8-02cb392e8c09 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:53.597886 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ea7d025-695c-4f2c-80b8-02cb392e8c09 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:53.733464 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0ea7d025-695c-4f2c-80b8-02cb392e8c09 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:53.743001 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0ea7d025-695c-4f2c-80b8-02cb392e8c09 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.156936 Jun 02 13:57:53.743865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 209/405] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:53 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:54.246305 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-940a5608-f251-4b7f-bed2-abbc06da8996 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:54.246919 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-940a5608-f251-4b7f-bed2-abbc06da8996 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:54.252936 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-940a5608-f251-4b7f-bed2-abbc06da8996 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:54.253385 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-940a5608-f251-4b7f-bed2-abbc06da8996 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:54.254139 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-940a5608-f251-4b7f-bed2-abbc06da8996 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:54.254571 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-940a5608-f251-4b7f-bed2-abbc06da8996 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:54.399904 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-940a5608-f251-4b7f-bed2-abbc06da8996 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:54.408570 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-940a5608-f251-4b7f-bed2-abbc06da8996 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:54.410339 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-940a5608-f251-4b7f-bed2-abbc06da8996 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:54.411615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-940a5608-f251-4b7f-bed2-abbc06da8996 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.169229 Jun 02 13:57:54.413267 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 197/406] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:57:54 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:57:54.542697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-aa57bd87-2c01-42db-be44-5e1ac93334ff tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:54.543312 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-aa57bd87-2c01-42db-be44-5e1ac93334ff tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:54.549417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aa57bd87-2c01-42db-be44-5e1ac93334ff tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:54.549866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aa57bd87-2c01-42db-be44-5e1ac93334ff tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:54.550617 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aa57bd87-2c01-42db-be44-5e1ac93334ff tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:54.551050 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aa57bd87-2c01-42db-be44-5e1ac93334ff tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:54.699381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-aa57bd87-2c01-42db-be44-5e1ac93334ff tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:54.703687 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-aa57bd87-2c01-42db-be44-5e1ac93334ff tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.164833 Jun 02 13:57:54.704490 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 210/407] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:54 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:54.760484 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-62c12e72-e2f7-4d78-8733-4480bd1ab8f3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:54.761437 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-62c12e72-e2f7-4d78-8733-4480bd1ab8f3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:54.768570 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-62c12e72-e2f7-4d78-8733-4480bd1ab8f3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:54.769266 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-62c12e72-e2f7-4d78-8733-4480bd1ab8f3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:54.770704 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-62c12e72-e2f7-4d78-8733-4480bd1ab8f3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:54.771548 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-62c12e72-e2f7-4d78-8733-4480bd1ab8f3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:54.918179 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-62c12e72-e2f7-4d78-8733-4480bd1ab8f3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:54.926046 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-62c12e72-e2f7-4d78-8733-4480bd1ab8f3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.170949 Jun 02 13:57:54.926757 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 198/408] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:54 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:55.431472 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7fd4c158-3a38-468a-bb03-9cf522a168af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:55.432106 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7fd4c158-3a38-468a-bb03-9cf522a168af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:55.438167 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7fd4c158-3a38-468a-bb03-9cf522a168af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:55.438611 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7fd4c158-3a38-468a-bb03-9cf522a168af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:55.439362 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7fd4c158-3a38-468a-bb03-9cf522a168af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:55.439799 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7fd4c158-3a38-468a-bb03-9cf522a168af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:55.582631 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7fd4c158-3a38-468a-bb03-9cf522a168af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:55.593562 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7fd4c158-3a38-468a-bb03-9cf522a168af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:55.595786 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7fd4c158-3a38-468a-bb03-9cf522a168af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:55.597178 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7fd4c158-3a38-468a-bb03-9cf522a168af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.169850 Jun 02 13:57:55.598039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 211/409] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:57:55 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:57:55.720647 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-dbec8f0c-827a-4bdc-a7cd-d6c1f4d197ed tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:55.721301 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-dbec8f0c-827a-4bdc-a7cd-d6c1f4d197ed tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:55.727945 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dbec8f0c-827a-4bdc-a7cd-d6c1f4d197ed tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:55.728440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dbec8f0c-827a-4bdc-a7cd-d6c1f4d197ed tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:55.729456 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dbec8f0c-827a-4bdc-a7cd-d6c1f4d197ed tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:55.729929 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dbec8f0c-827a-4bdc-a7cd-d6c1f4d197ed tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:55.876099 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-dbec8f0c-827a-4bdc-a7cd-d6c1f4d197ed tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:55.885439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-dbec8f0c-827a-4bdc-a7cd-d6c1f4d197ed tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.168589 Jun 02 13:57:55.886302 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 199/410] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:55 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:55.943106 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e1669e87-0278-4562-8c93-68443fe52b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:55.944461 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e1669e87-0278-4562-8c93-68443fe52b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:55.950924 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e1669e87-0278-4562-8c93-68443fe52b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:55.959126 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e1669e87-0278-4562-8c93-68443fe52b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:55.959126 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e1669e87-0278-4562-8c93-68443fe52b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:55.959126 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e1669e87-0278-4562-8c93-68443fe52b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:56.096701 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e1669e87-0278-4562-8c93-68443fe52b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:56.117707 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e1669e87-0278-4562-8c93-68443fe52b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.178330 Jun 02 13:57:56.118305 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 212/411] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:55 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:56.619674 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-dcb5ddd3-b438-4775-a5b9-969e3f46f3da tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:56.620573 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-dcb5ddd3-b438-4775-a5b9-969e3f46f3da tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:56.627306 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dcb5ddd3-b438-4775-a5b9-969e3f46f3da tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:56.628890 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dcb5ddd3-b438-4775-a5b9-969e3f46f3da tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:56.629890 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dcb5ddd3-b438-4775-a5b9-969e3f46f3da tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:56.630665 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dcb5ddd3-b438-4775-a5b9-969e3f46f3da tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:56.803986 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-dcb5ddd3-b438-4775-a5b9-969e3f46f3da tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:56.813388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-dcb5ddd3-b438-4775-a5b9-969e3f46f3da tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:56.814970 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-dcb5ddd3-b438-4775-a5b9-969e3f46f3da tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:56.816304 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-dcb5ddd3-b438-4775-a5b9-969e3f46f3da tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.201333 Jun 02 13:57:56.816932 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 200/412] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:57:56 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:57:56.905660 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c0644a4a-b1ae-4f61-be2f-215599400fbc tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:56.906383 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c0644a4a-b1ae-4f61-be2f-215599400fbc tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:56.915897 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c0644a4a-b1ae-4f61-be2f-215599400fbc tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:56.918856 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c0644a4a-b1ae-4f61-be2f-215599400fbc tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:56.919661 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c0644a4a-b1ae-4f61-be2f-215599400fbc tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:56.920097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c0644a4a-b1ae-4f61-be2f-215599400fbc tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:57.106401 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c0644a4a-b1ae-4f61-be2f-215599400fbc tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:57.113998 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c0644a4a-b1ae-4f61-be2f-215599400fbc tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.214911 Jun 02 13:57:57.114565 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 213/413] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:56 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:57.135410 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0eaff55e-e20c-461f-96e9-c18c57fd2bd5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:57.136056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0eaff55e-e20c-461f-96e9-c18c57fd2bd5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:57.142316 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0eaff55e-e20c-461f-96e9-c18c57fd2bd5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:57.142767 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0eaff55e-e20c-461f-96e9-c18c57fd2bd5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:57.143555 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0eaff55e-e20c-461f-96e9-c18c57fd2bd5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:57.143994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0eaff55e-e20c-461f-96e9-c18c57fd2bd5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:57.340753 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0eaff55e-e20c-461f-96e9-c18c57fd2bd5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:57.351794 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0eaff55e-e20c-461f-96e9-c18c57fd2bd5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.219178 Jun 02 13:57:57.353251 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 201/414] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:57 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:57.837374 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8edd90b0-9b50-42c9-ae5b-f5870e4113d8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:57.842843 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8edd90b0-9b50-42c9-ae5b-f5870e4113d8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:57.853786 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8edd90b0-9b50-42c9-ae5b-f5870e4113d8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:57.854549 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8edd90b0-9b50-42c9-ae5b-f5870e4113d8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:57.855508 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8edd90b0-9b50-42c9-ae5b-f5870e4113d8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:57.858519 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8edd90b0-9b50-42c9-ae5b-f5870e4113d8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:58.015075 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8edd90b0-9b50-42c9-ae5b-f5870e4113d8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:58.024821 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8edd90b0-9b50-42c9-ae5b-f5870e4113d8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:58.026632 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8edd90b0-9b50-42c9-ae5b-f5870e4113d8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:58.027945 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8edd90b0-9b50-42c9-ae5b-f5870e4113d8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.196680 Jun 02 13:57:58.030409 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 214/415] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:57:57 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:57:58.131824 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d4efdd38-8358-4b51-b974-20fabab24778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:58.136206 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d4efdd38-8358-4b51-b974-20fabab24778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:58.141117 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d4efdd38-8358-4b51-b974-20fabab24778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:58.141659 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d4efdd38-8358-4b51-b974-20fabab24778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:58.142509 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d4efdd38-8358-4b51-b974-20fabab24778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:58.143014 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d4efdd38-8358-4b51-b974-20fabab24778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:58.314615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d4efdd38-8358-4b51-b974-20fabab24778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:58.323348 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d4efdd38-8358-4b51-b974-20fabab24778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.196062 Jun 02 13:57:58.335154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 202/416] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:58 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:58.370387 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-555a20d2-2c41-46f8-a790-1b56abd705d4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:58.371004 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-555a20d2-2c41-46f8-a790-1b56abd705d4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:58.382867 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-555a20d2-2c41-46f8-a790-1b56abd705d4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:58.386907 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-555a20d2-2c41-46f8-a790-1b56abd705d4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:58.387957 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-555a20d2-2c41-46f8-a790-1b56abd705d4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:58.388692 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-555a20d2-2c41-46f8-a790-1b56abd705d4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:58.560076 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-555a20d2-2c41-46f8-a790-1b56abd705d4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:58.568491 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-555a20d2-2c41-46f8-a790-1b56abd705d4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.201968 Jun 02 13:57:58.574980 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 215/417] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:58 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:59.052199 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-86199694-521b-463f-ad88-4a27e18390c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:59.052199 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-86199694-521b-463f-ad88-4a27e18390c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:59.055946 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-86199694-521b-463f-ad88-4a27e18390c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:59.056418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-86199694-521b-463f-ad88-4a27e18390c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:59.057203 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-86199694-521b-463f-ad88-4a27e18390c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:59.057638 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-86199694-521b-463f-ad88-4a27e18390c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:59.206619 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-86199694-521b-463f-ad88-4a27e18390c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:59.214813 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-86199694-521b-463f-ad88-4a27e18390c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:59.216343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-86199694-521b-463f-ad88-4a27e18390c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:59.217786 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-86199694-521b-463f-ad88-4a27e18390c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.175345 Jun 02 13:57:59.218390 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 203/418] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:57:59 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:57:59.372371 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-897d15cd-8097-45e5-8451-6e11976deae4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:59.372371 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-897d15cd-8097-45e5-8451-6e11976deae4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:59.372371 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-897d15cd-8097-45e5-8451-6e11976deae4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:59.372371 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-897d15cd-8097-45e5-8451-6e11976deae4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:59.373317 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-897d15cd-8097-45e5-8451-6e11976deae4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:59.373317 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-897d15cd-8097-45e5-8451-6e11976deae4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:59.500546 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-897d15cd-8097-45e5-8451-6e11976deae4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:59.511894 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-897d15cd-8097-45e5-8451-6e11976deae4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.173254 Jun 02 13:57:59.512515 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 216/419] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:59 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:57:59.595311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b8baa768-c749-4483-826d-117476064b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:57:59.596046 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b8baa768-c749-4483-826d-117476064b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:57:59.602496 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8baa768-c749-4483-826d-117476064b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:59.603674 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8baa768-c749-4483-826d-117476064b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:59.604611 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8baa768-c749-4483-826d-117476064b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:57:59.605133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8baa768-c749-4483-826d-117476064b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:57:59.780674 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b8baa768-c749-4483-826d-117476064b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:57:59.793639 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b8baa768-c749-4483-826d-117476064b7d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.201747 Jun 02 13:57:59.793639 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 204/420] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:57:59 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:00.236846 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e3f58dcb-af48-48ee-8135-0e9d49fec88e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:00.237857 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e3f58dcb-af48-48ee-8135-0e9d49fec88e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:00.248889 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e3f58dcb-af48-48ee-8135-0e9d49fec88e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:00.250397 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e3f58dcb-af48-48ee-8135-0e9d49fec88e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:00.252283 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e3f58dcb-af48-48ee-8135-0e9d49fec88e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:00.253207 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e3f58dcb-af48-48ee-8135-0e9d49fec88e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:00.472637 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e3f58dcb-af48-48ee-8135-0e9d49fec88e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:00.483744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e3f58dcb-af48-48ee-8135-0e9d49fec88e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:00.485585 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e3f58dcb-af48-48ee-8135-0e9d49fec88e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:00.487476 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e3f58dcb-af48-48ee-8135-0e9d49fec88e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.254810 Jun 02 13:58:00.499666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 217/421] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:00 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:00.529918 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-054e2ac6-3409-462d-855d-6823e9768051 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:00.530580 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-054e2ac6-3409-462d-855d-6823e9768051 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:00.541044 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-054e2ac6-3409-462d-855d-6823e9768051 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:00.541489 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-054e2ac6-3409-462d-855d-6823e9768051 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:00.542459 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-054e2ac6-3409-462d-855d-6823e9768051 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:00.543243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-054e2ac6-3409-462d-855d-6823e9768051 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:00.807886 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ef9d7e33-8338-4f4f-9d4d-138ebd4b6810 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:00.808680 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ef9d7e33-8338-4f4f-9d4d-138ebd4b6810 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:00.815902 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ef9d7e33-8338-4f4f-9d4d-138ebd4b6810 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:00.816711 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ef9d7e33-8338-4f4f-9d4d-138ebd4b6810 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:00.824797 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ef9d7e33-8338-4f4f-9d4d-138ebd4b6810 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:00.824797 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ef9d7e33-8338-4f4f-9d4d-138ebd4b6810 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:00.835002 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-054e2ac6-3409-462d-855d-6823e9768051 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:00.848471 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-054e2ac6-3409-462d-855d-6823e9768051 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.320260 Jun 02 13:58:00.859354 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 205/422] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:00 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:01.068151 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ef9d7e33-8338-4f4f-9d4d-138ebd4b6810 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:01.077229 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ef9d7e33-8338-4f4f-9d4d-138ebd4b6810 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.274092 Jun 02 13:58:01.078150 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 218/423] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:00 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:01.510325 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0f65ea0a-3b8f-452a-b190-cc931a5ae153 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:01.511367 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0f65ea0a-3b8f-452a-b190-cc931a5ae153 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:01.527087 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0f65ea0a-3b8f-452a-b190-cc931a5ae153 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:01.528004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0f65ea0a-3b8f-452a-b190-cc931a5ae153 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:01.529298 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0f65ea0a-3b8f-452a-b190-cc931a5ae153 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:01.532804 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0f65ea0a-3b8f-452a-b190-cc931a5ae153 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:01.753098 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0f65ea0a-3b8f-452a-b190-cc931a5ae153 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:01.761594 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0f65ea0a-3b8f-452a-b190-cc931a5ae153 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:01.763824 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0f65ea0a-3b8f-452a-b190-cc931a5ae153 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:01.765175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0f65ea0a-3b8f-452a-b190-cc931a5ae153 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.261188 Jun 02 13:58:01.765739 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 206/424] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:01 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:01.867410 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-194113c1-a670-4c20-922e-ddd2a23e8255 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:01.868193 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-194113c1-a670-4c20-922e-ddd2a23e8255 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:01.875929 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-194113c1-a670-4c20-922e-ddd2a23e8255 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:01.882619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-194113c1-a670-4c20-922e-ddd2a23e8255 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:01.882619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-194113c1-a670-4c20-922e-ddd2a23e8255 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:01.882619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-194113c1-a670-4c20-922e-ddd2a23e8255 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:02.096072 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-82e794ee-9f0a-48b5-b2fe-a28a37101858 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:02.097244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-82e794ee-9f0a-48b5-b2fe-a28a37101858 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:02.105922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-82e794ee-9f0a-48b5-b2fe-a28a37101858 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:02.106705 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-82e794ee-9f0a-48b5-b2fe-a28a37101858 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:02.107945 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-82e794ee-9f0a-48b5-b2fe-a28a37101858 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:02.108739 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-82e794ee-9f0a-48b5-b2fe-a28a37101858 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:02.152323 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-194113c1-a670-4c20-922e-ddd2a23e8255 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:02.161563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-194113c1-a670-4c20-922e-ddd2a23e8255 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.299651 Jun 02 13:58:02.183957 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 219/425] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:01 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:02.390436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-82e794ee-9f0a-48b5-b2fe-a28a37101858 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:02.403192 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-82e794ee-9f0a-48b5-b2fe-a28a37101858 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.311813 Jun 02 13:58:02.403797 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 207/426] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:02 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:02.784529 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2db75183-e7ca-41b7-83f4-ef1763b2eb6e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:02.785146 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2db75183-e7ca-41b7-83f4-ef1763b2eb6e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:02.791984 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2db75183-e7ca-41b7-83f4-ef1763b2eb6e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:02.792309 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2db75183-e7ca-41b7-83f4-ef1763b2eb6e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:02.793082 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2db75183-e7ca-41b7-83f4-ef1763b2eb6e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:02.793543 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2db75183-e7ca-41b7-83f4-ef1763b2eb6e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:03.017494 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2db75183-e7ca-41b7-83f4-ef1763b2eb6e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:03.026905 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2db75183-e7ca-41b7-83f4-ef1763b2eb6e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:03.028513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2db75183-e7ca-41b7-83f4-ef1763b2eb6e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:03.029685 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2db75183-e7ca-41b7-83f4-ef1763b2eb6e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.249232 Jun 02 13:58:03.035086 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 220/427] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:02 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:58:03.192941 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-03bdce83-6a07-4736-b8b6-562e18640bf7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:03.193714 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-03bdce83-6a07-4736-b8b6-562e18640bf7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:03.205233 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-03bdce83-6a07-4736-b8b6-562e18640bf7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:03.205233 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-03bdce83-6a07-4736-b8b6-562e18640bf7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:03.206164 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-03bdce83-6a07-4736-b8b6-562e18640bf7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:03.206883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-03bdce83-6a07-4736-b8b6-562e18640bf7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:03.420897 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9e3492dc-9747-4cbe-94db-430829f85680 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:03.421622 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9e3492dc-9747-4cbe-94db-430829f85680 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:03.428807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9e3492dc-9747-4cbe-94db-430829f85680 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:03.429252 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9e3492dc-9747-4cbe-94db-430829f85680 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:03.430017 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9e3492dc-9747-4cbe-94db-430829f85680 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:03.430488 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9e3492dc-9747-4cbe-94db-430829f85680 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:03.433552 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-03bdce83-6a07-4736-b8b6-562e18640bf7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:03.441874 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-03bdce83-6a07-4736-b8b6-562e18640bf7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.256222 Jun 02 13:58:03.443049 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 208/428] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:03 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:03.681431 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9e3492dc-9747-4cbe-94db-430829f85680 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:03.693127 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9e3492dc-9747-4cbe-94db-430829f85680 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.276206 Jun 02 13:58:03.717286 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 221/429] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:03 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:58:04.047743 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-725881e1-617e-49c7-95a4-ac46c1d13c84 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:04.048683 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-725881e1-617e-49c7-95a4-ac46c1d13c84 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:04.056456 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-725881e1-617e-49c7-95a4-ac46c1d13c84 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:04.056907 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-725881e1-617e-49c7-95a4-ac46c1d13c84 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:04.057665 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-725881e1-617e-49c7-95a4-ac46c1d13c84 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:04.058850 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-725881e1-617e-49c7-95a4-ac46c1d13c84 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:04.081832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=100 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:04.329961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-725881e1-617e-49c7-95a4-ac46c1d13c84 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:04.343711 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-725881e1-617e-49c7-95a4-ac46c1d13c84 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:04.345292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-725881e1-617e-49c7-95a4-ac46c1d13c84 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:04.346699 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-725881e1-617e-49c7-95a4-ac46c1d13c84 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.302962 Jun 02 13:58:04.347430 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 209/430] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:04 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:58:04.459339 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-60f50b07-8695-457a-adec-0556a3018711 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:04.460783 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-60f50b07-8695-457a-adec-0556a3018711 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:04.467004 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-60f50b07-8695-457a-adec-0556a3018711 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:04.467535 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-60f50b07-8695-457a-adec-0556a3018711 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:04.468781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-60f50b07-8695-457a-adec-0556a3018711 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:04.469591 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-60f50b07-8695-457a-adec-0556a3018711 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:04.683027 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-60f50b07-8695-457a-adec-0556a3018711 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:04.697097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-60f50b07-8695-457a-adec-0556a3018711 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.239403 Jun 02 13:58:04.698300 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 222/431] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:04 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:04.712518 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-018dffc9-8fdc-4e38-adc7-41f1b354a548 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:04.713369 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-018dffc9-8fdc-4e38-adc7-41f1b354a548 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:04.723494 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-018dffc9-8fdc-4e38-adc7-41f1b354a548 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:04.723728 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-018dffc9-8fdc-4e38-adc7-41f1b354a548 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:04.727604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-018dffc9-8fdc-4e38-adc7-41f1b354a548 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:04.728725 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-018dffc9-8fdc-4e38-adc7-41f1b354a548 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:04.965728 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-018dffc9-8fdc-4e38-adc7-41f1b354a548 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:04.976546 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-018dffc9-8fdc-4e38-adc7-41f1b354a548 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.268172 Jun 02 13:58:04.986195 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 210/432] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:04 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:58:05.370737 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d6252770-dc0c-42fb-ac4d-69bbe3341c6a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:05.372052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d6252770-dc0c-42fb-ac4d-69bbe3341c6a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:05.374411 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:05.385198 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6252770-dc0c-42fb-ac4d-69bbe3341c6a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:05.386619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6252770-dc0c-42fb-ac4d-69bbe3341c6a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:05.392859 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6252770-dc0c-42fb-ac4d-69bbe3341c6a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:05.392859 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6252770-dc0c-42fb-ac4d-69bbe3341c6a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:05.586813 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d6252770-dc0c-42fb-ac4d-69bbe3341c6a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:05.590623 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:05.601657 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d6252770-dc0c-42fb-ac4d-69bbe3341c6a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:05.601657 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d6252770-dc0c-42fb-ac4d-69bbe3341c6a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:05.601657 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d6252770-dc0c-42fb-ac4d-69bbe3341c6a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.236856 Jun 02 13:58:05.602809 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 223/433] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:05 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:05.715123 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e2a582b8-e802-471c-91b9-5cdde9e37eef tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:05.715747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e2a582b8-e802-471c-91b9-5cdde9e37eef tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:05.723164 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:05.728282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e2a582b8-e802-471c-91b9-5cdde9e37eef tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:05.728767 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e2a582b8-e802-471c-91b9-5cdde9e37eef tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:05.729534 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e2a582b8-e802-471c-91b9-5cdde9e37eef tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:05.730149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e2a582b8-e802-471c-91b9-5cdde9e37eef tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:05.993938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-eaae45bb-7771-4488-b122-e063184ea1ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:05.994775 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-eaae45bb-7771-4488-b122-e063184ea1ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:06.002183 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eaae45bb-7771-4488-b122-e063184ea1ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:06.002630 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eaae45bb-7771-4488-b122-e063184ea1ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:06.003719 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eaae45bb-7771-4488-b122-e063184ea1ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:06.004008 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eaae45bb-7771-4488-b122-e063184ea1ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:06.006670 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e2a582b8-e802-471c-91b9-5cdde9e37eef tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:06.016026 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e2a582b8-e802-471c-91b9-5cdde9e37eef tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.304782 Jun 02 13:58:06.016640 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 211/434] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:05 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:06.480186 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-eaae45bb-7771-4488-b122-e063184ea1ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:06.494263 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-eaae45bb-7771-4488-b122-e063184ea1ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.504621 Jun 02 13:58:06.504032 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 224/435] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:05 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:06.622760 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c5620b1c-973f-4bec-9984-5de43829e2c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:06.623503 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c5620b1c-973f-4bec-9984-5de43829e2c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:06.643163 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c5620b1c-973f-4bec-9984-5de43829e2c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:06.643617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c5620b1c-973f-4bec-9984-5de43829e2c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:06.644462 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c5620b1c-973f-4bec-9984-5de43829e2c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:06.644871 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c5620b1c-973f-4bec-9984-5de43829e2c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:06.881892 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c5620b1c-973f-4bec-9984-5de43829e2c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:06.892037 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c5620b1c-973f-4bec-9984-5de43829e2c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:06.894230 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c5620b1c-973f-4bec-9984-5de43829e2c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:06.895693 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c5620b1c-973f-4bec-9984-5de43829e2c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.276911 Jun 02 13:58:06.897084 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 212/436] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:06 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:07.035381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-818e35a9-2065-4d48-a749-df70762453ca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:07.036156 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-818e35a9-2065-4d48-a749-df70762453ca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:07.043472 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-818e35a9-2065-4d48-a749-df70762453ca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:07.044069 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-818e35a9-2065-4d48-a749-df70762453ca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:07.045295 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-818e35a9-2065-4d48-a749-df70762453ca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:07.046664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-818e35a9-2065-4d48-a749-df70762453ca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:07.207700 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-818e35a9-2065-4d48-a749-df70762453ca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:07.216457 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-818e35a9-2065-4d48-a749-df70762453ca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.184996 Jun 02 13:58:07.217040 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 225/437] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:07 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:07.435957 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-56b1f652-a9d5-472b-b7e5-c7261bbb3694 req-fe5f0492-c5d8-4d90-b360-6f83136ee810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff8b777-591b-48fc-8e08-8722d8a3adca", "name": "network-vif-plugged", "status": "completed", "tag": "5161504c-7de3-4d83-8150-813b7b219462"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:58:07.444813 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-56b1f652-a9d5-472b-b7e5-c7261bbb3694 req-fe5f0492-c5d8-4d90-b360-6f83136ee810 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:07.445257 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-56b1f652-a9d5-472b-b7e5-c7261bbb3694 req-fe5f0492-c5d8-4d90-b360-6f83136ee810 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:07.457071 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-56b1f652-a9d5-472b-b7e5-c7261bbb3694 req-fe5f0492-c5d8-4d90-b360-6f83136ee810 service nova] Creating event network-vif-plugged:5161504c-7de3-4d83-8150-813b7b219462 for instance 6ff8b777-591b-48fc-8e08-8722d8a3adca on hv-cinder-82651 Jun 02 13:58:07.462581 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-56b1f652-a9d5-472b-b7e5-c7261bbb3694 req-fe5f0492-c5d8-4d90-b360-6f83136ee810 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030278 Jun 02 13:58:07.464323 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 213/438] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:58:07.511782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-752a99fe-81e3-4ffd-b8f2-1474fdf284bd tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:07.512534 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-752a99fe-81e3-4ffd-b8f2-1474fdf284bd tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:07.521256 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-752a99fe-81e3-4ffd-b8f2-1474fdf284bd tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:07.525144 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-752a99fe-81e3-4ffd-b8f2-1474fdf284bd tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:07.526649 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-752a99fe-81e3-4ffd-b8f2-1474fdf284bd tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:07.527286 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-752a99fe-81e3-4ffd-b8f2-1474fdf284bd tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:07.689662 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-752a99fe-81e3-4ffd-b8f2-1474fdf284bd tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:07.697781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-752a99fe-81e3-4ffd-b8f2-1474fdf284bd tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.189936 Jun 02 13:58:07.698355 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 226/439] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:07 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:07.916043 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-6792a6e0-808d-43d6-a9b6-bb072405be75 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:07.916836 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-6792a6e0-808d-43d6-a9b6-bb072405be75 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:07.930888 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6792a6e0-808d-43d6-a9b6-bb072405be75 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:07.931908 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6792a6e0-808d-43d6-a9b6-bb072405be75 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:07.933138 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6792a6e0-808d-43d6-a9b6-bb072405be75 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:07.936969 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6792a6e0-808d-43d6-a9b6-bb072405be75 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:08.088662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6792a6e0-808d-43d6-a9b6-bb072405be75 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:08.098005 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6792a6e0-808d-43d6-a9b6-bb072405be75 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:08.099565 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6792a6e0-808d-43d6-a9b6-bb072405be75 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:08.101946 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-6792a6e0-808d-43d6-a9b6-bb072405be75 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1744 microversion: 2.20 time: 0.191471 Jun 02 13:58:08.114176 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 214/440] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:07 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1744 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:08.233692 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6973d7a3-452f-463a-bd4b-66f25dfabbb2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:08.236446 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6973d7a3-452f-463a-bd4b-66f25dfabbb2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:08.251451 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6973d7a3-452f-463a-bd4b-66f25dfabbb2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:08.252022 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6973d7a3-452f-463a-bd4b-66f25dfabbb2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:08.252826 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6973d7a3-452f-463a-bd4b-66f25dfabbb2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:08.253256 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6973d7a3-452f-463a-bd4b-66f25dfabbb2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:08.411417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6973d7a3-452f-463a-bd4b-66f25dfabbb2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:08.420678 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6973d7a3-452f-463a-bd4b-66f25dfabbb2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.190918 Jun 02 13:58:08.421589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 227/441] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:08 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:08.715764 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ff32de11-1203-45ff-aa73-e72263297833 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:08.716521 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ff32de11-1203-45ff-aa73-e72263297833 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:08.724270 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ff32de11-1203-45ff-aa73-e72263297833 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:08.729496 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ff32de11-1203-45ff-aa73-e72263297833 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:08.730536 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ff32de11-1203-45ff-aa73-e72263297833 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:08.730971 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ff32de11-1203-45ff-aa73-e72263297833 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:08.923338 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ff32de11-1203-45ff-aa73-e72263297833 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:08.936605 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ff32de11-1203-45ff-aa73-e72263297833 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.224554 Jun 02 13:58:08.939694 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 215/442] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:08 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:09.123274 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-96c7820e-0414-4521-8a42-6ac1722c6202 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:09.123806 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-96c7820e-0414-4521-8a42-6ac1722c6202 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:09.130719 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-96c7820e-0414-4521-8a42-6ac1722c6202 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:09.131438 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-96c7820e-0414-4521-8a42-6ac1722c6202 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:09.132553 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-96c7820e-0414-4521-8a42-6ac1722c6202 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:09.133225 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-96c7820e-0414-4521-8a42-6ac1722c6202 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:09.316613 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-96c7820e-0414-4521-8a42-6ac1722c6202 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:09.333431 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-96c7820e-0414-4521-8a42-6ac1722c6202 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:09.335808 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-96c7820e-0414-4521-8a42-6ac1722c6202 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:09.337272 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-96c7820e-0414-4521-8a42-6ac1722c6202 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1744 microversion: 2.20 time: 0.220098 Jun 02 13:58:09.338058 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 228/443] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:09 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:58:09.440033 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5f6003bf-a9de-4371-850f-a170664c421c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:09.440998 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5f6003bf-a9de-4371-850f-a170664c421c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:09.458079 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f6003bf-a9de-4371-850f-a170664c421c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:09.458898 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f6003bf-a9de-4371-850f-a170664c421c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:09.460938 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f6003bf-a9de-4371-850f-a170664c421c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:09.463920 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f6003bf-a9de-4371-850f-a170664c421c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:09.514142 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-1052b7ab-215b-4bcc-9623-50c90c34669b req-33014500-6bc6-4100-b756-cadbd83d187a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4253a95d-5443-4a20-9a10-621c058e8674", "name": "network-vif-plugged", "status": "completed", "tag": "7e76fdd4-e430-47ed-aee9-504128683d44"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:58:09.531460 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-1052b7ab-215b-4bcc-9623-50c90c34669b req-33014500-6bc6-4100-b756-cadbd83d187a service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:09.535556 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-1052b7ab-215b-4bcc-9623-50c90c34669b req-33014500-6bc6-4100-b756-cadbd83d187a service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:09.559385 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-1052b7ab-215b-4bcc-9623-50c90c34669b req-33014500-6bc6-4100-b756-cadbd83d187a service nova] Creating event network-vif-plugged:7e76fdd4-e430-47ed-aee9-504128683d44 for instance 4253a95d-5443-4a20-9a10-621c058e8674 on hv-cinder-82651 Jun 02 13:58:09.566525 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-1052b7ab-215b-4bcc-9623-50c90c34669b req-33014500-6bc6-4100-b756-cadbd83d187a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056697 Jun 02 13:58:09.574728 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 229/444] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:58:09.670547 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5f6003bf-a9de-4371-850f-a170664c421c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:09.679552 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5f6003bf-a9de-4371-850f-a170664c421c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.243803 Jun 02 13:58:09.681374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 216/445] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:09 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:09.960625 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-63532273-3b80-478e-9afc-feb1965741ef tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:09.961881 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-63532273-3b80-478e-9afc-feb1965741ef tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:09.969147 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-63532273-3b80-478e-9afc-feb1965741ef tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:09.969892 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-63532273-3b80-478e-9afc-feb1965741ef tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:09.970741 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-63532273-3b80-478e-9afc-feb1965741ef tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:09.971454 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-63532273-3b80-478e-9afc-feb1965741ef tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:10.152910 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-63532273-3b80-478e-9afc-feb1965741ef tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:10.164090 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-63532273-3b80-478e-9afc-feb1965741ef tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1265 microversion: 2.1 time: 0.208149 Jun 02 13:58:10.166002 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 230/446] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:09 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:10.360414 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-9a3e42f4-188d-4d81-b21a-eb389f56997a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:10.361038 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-9a3e42f4-188d-4d81-b21a-eb389f56997a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:10.371988 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9a3e42f4-188d-4d81-b21a-eb389f56997a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:10.375971 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9a3e42f4-188d-4d81-b21a-eb389f56997a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:10.381822 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9a3e42f4-188d-4d81-b21a-eb389f56997a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:10.382526 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9a3e42f4-188d-4d81-b21a-eb389f56997a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:10.683786 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-9a3e42f4-188d-4d81-b21a-eb389f56997a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:10.711096 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-9a3e42f4-188d-4d81-b21a-eb389f56997a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:10.713843 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-9a3e42f4-188d-4d81-b21a-eb389f56997a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:10.725952 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-07c54b47-5fb0-4097-ac4a-ff67d9a36f8c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:10.726698 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-07c54b47-5fb0-4097-ac4a-ff67d9a36f8c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:10.734837 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-9a3e42f4-188d-4d81-b21a-eb389f56997a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1744 microversion: 2.20 time: 0.377147 Jun 02 13:58:10.753730 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 217/447] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:10 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1744 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:10.754300 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-07c54b47-5fb0-4097-ac4a-ff67d9a36f8c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:10.754752 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-07c54b47-5fb0-4097-ac4a-ff67d9a36f8c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:10.756113 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-07c54b47-5fb0-4097-ac4a-ff67d9a36f8c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:10.763094 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-07c54b47-5fb0-4097-ac4a-ff67d9a36f8c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:11.043526 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-07c54b47-5fb0-4097-ac4a-ff67d9a36f8c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:11.060056 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-07c54b47-5fb0-4097-ac4a-ff67d9a36f8c tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.339424 Jun 02 13:58:11.061001 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 231/448] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:10 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:11.181380 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a86e5de6-b69e-4a9d-9de9-6b78cce63460 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:11.182001 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a86e5de6-b69e-4a9d-9de9-6b78cce63460 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:11.201721 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a86e5de6-b69e-4a9d-9de9-6b78cce63460 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:11.202096 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a86e5de6-b69e-4a9d-9de9-6b78cce63460 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:11.202890 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a86e5de6-b69e-4a9d-9de9-6b78cce63460 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:11.203333 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a86e5de6-b69e-4a9d-9de9-6b78cce63460 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:11.371522 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a86e5de6-b69e-4a9d-9de9-6b78cce63460 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:11.380013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a86e5de6-b69e-4a9d-9de9-6b78cce63460 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1452 microversion: 2.1 time: 0.202446 Jun 02 13:58:11.381298 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 218/449] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:11 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1452 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:11.402731 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7bf3f172-ff54-46c0-ac42-155db0c92f45 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:11.410565 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7bf3f172-ff54-46c0-ac42-155db0c92f45 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:11.410565 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7bf3f172-ff54-46c0-ac42-155db0c92f45 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:11.410565 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7bf3f172-ff54-46c0-ac42-155db0c92f45 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:11.410903 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7bf3f172-ff54-46c0-ac42-155db0c92f45 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:11.411268 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7bf3f172-ff54-46c0-ac42-155db0c92f45 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:11.564994 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7bf3f172-ff54-46c0-ac42-155db0c92f45 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:11.572525 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7bf3f172-ff54-46c0-ac42-155db0c92f45 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1452 microversion: 2.1 time: 0.173767 Jun 02 13:58:11.573110 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 232/450] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:11 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:11.594707 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-ce6a29d5-12f8-453d-bea6-b945e8a386de req-a0cf5d1a-f4c0-4e6a-a1ed-2d7ccee8762a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d462ae-af14-4d5d-aab2-f45954429480", "name": "network-vif-plugged", "status": "completed", "tag": "9494633c-b230-4406-ab57-d1f3d39fc4d6"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:58:11.603733 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-ce6a29d5-12f8-453d-bea6-b945e8a386de req-a0cf5d1a-f4c0-4e6a-a1ed-2d7ccee8762a service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:11.604266 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-ce6a29d5-12f8-453d-bea6-b945e8a386de req-a0cf5d1a-f4c0-4e6a-a1ed-2d7ccee8762a service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:11.615511 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-ce6a29d5-12f8-453d-bea6-b945e8a386de req-a0cf5d1a-f4c0-4e6a-a1ed-2d7ccee8762a service nova] Creating event network-vif-plugged:9494633c-b230-4406-ab57-d1f3d39fc4d6 for instance 83d462ae-af14-4d5d-aab2-f45954429480 on hv-cinder-82651 Jun 02 13:58:11.620632 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-ce6a29d5-12f8-453d-bea6-b945e8a386de req-a0cf5d1a-f4c0-4e6a-a1ed-2d7ccee8762a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029743 Jun 02 13:58:11.621217 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 219/451] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:58:11.756277 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-932888f8-a1fb-45bc-a9e5-7e87292c22a8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:11.756873 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-932888f8-a1fb-45bc-a9e5-7e87292c22a8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:11.762821 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-932888f8-a1fb-45bc-a9e5-7e87292c22a8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:11.763307 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-932888f8-a1fb-45bc-a9e5-7e87292c22a8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:11.764052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-932888f8-a1fb-45bc-a9e5-7e87292c22a8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:11.764498 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-932888f8-a1fb-45bc-a9e5-7e87292c22a8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:11.911808 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-932888f8-a1fb-45bc-a9e5-7e87292c22a8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:11.920758 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-932888f8-a1fb-45bc-a9e5-7e87292c22a8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:11.922282 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-932888f8-a1fb-45bc-a9e5-7e87292c22a8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:11.923456 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-932888f8-a1fb-45bc-a9e5-7e87292c22a8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1744 microversion: 2.20 time: 0.171881 Jun 02 13:58:11.924015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 233/452] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:11 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:12.079683 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-61b55fd9-8ad8-4fb1-9f30-e52cf3e43d74 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:12.080381 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-61b55fd9-8ad8-4fb1-9f30-e52cf3e43d74 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:12.088850 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-61b55fd9-8ad8-4fb1-9f30-e52cf3e43d74 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:12.089296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-61b55fd9-8ad8-4fb1-9f30-e52cf3e43d74 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:12.090053 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-61b55fd9-8ad8-4fb1-9f30-e52cf3e43d74 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:12.090499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-61b55fd9-8ad8-4fb1-9f30-e52cf3e43d74 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:12.252139 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-61b55fd9-8ad8-4fb1-9f30-e52cf3e43d74 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:12.264593 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-61b55fd9-8ad8-4fb1-9f30-e52cf3e43d74 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.190769 Jun 02 13:58:12.274959 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 220/453] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:12 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:12.941197 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7f481a0a-1b5e-4a3a-9a06-eb5a5d8fc82b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:12.941798 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7f481a0a-1b5e-4a3a-9a06-eb5a5d8fc82b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:12.948112 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7f481a0a-1b5e-4a3a-9a06-eb5a5d8fc82b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:12.952617 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7f481a0a-1b5e-4a3a-9a06-eb5a5d8fc82b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:12.952617 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7f481a0a-1b5e-4a3a-9a06-eb5a5d8fc82b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:12.952617 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7f481a0a-1b5e-4a3a-9a06-eb5a5d8fc82b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:13.160990 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7f481a0a-1b5e-4a3a-9a06-eb5a5d8fc82b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:13.172198 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7f481a0a-1b5e-4a3a-9a06-eb5a5d8fc82b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:13.174098 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7f481a0a-1b5e-4a3a-9a06-eb5a5d8fc82b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:13.179702 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7f481a0a-1b5e-4a3a-9a06-eb5a5d8fc82b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1744 microversion: 2.20 time: 0.238121 Jun 02 13:58:13.179702 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 234/454] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:12 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1744 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:13.282526 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-54a6a977-4909-4143-b2dd-8a3c78cc25cb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:13.284394 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-54a6a977-4909-4143-b2dd-8a3c78cc25cb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:13.295123 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54a6a977-4909-4143-b2dd-8a3c78cc25cb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:13.295663 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54a6a977-4909-4143-b2dd-8a3c78cc25cb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:13.296523 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54a6a977-4909-4143-b2dd-8a3c78cc25cb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:13.296903 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54a6a977-4909-4143-b2dd-8a3c78cc25cb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:13.470070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-54a6a977-4909-4143-b2dd-8a3c78cc25cb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:13.482394 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-54a6a977-4909-4143-b2dd-8a3c78cc25cb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1261 microversion: 2.1 time: 0.204026 Jun 02 13:58:13.483419 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 221/455] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:13 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1261 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:14.106265 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-9480326d-1df2-49c0-acdf-46354bb58a93 req-c9f93778-c92c-4d54-8532-b9b33cd00e14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff8b777-591b-48fc-8e08-8722d8a3adca", "tag": "5161504c-7de3-4d83-8150-813b7b219462"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:58:14.122079 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-9480326d-1df2-49c0-acdf-46354bb58a93 req-c9f93778-c92c-4d54-8532-b9b33cd00e14 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:14.122831 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-9480326d-1df2-49c0-acdf-46354bb58a93 req-c9f93778-c92c-4d54-8532-b9b33cd00e14 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:14.146755 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-9480326d-1df2-49c0-acdf-46354bb58a93 req-c9f93778-c92c-4d54-8532-b9b33cd00e14 service nova] Creating event network-changed:5161504c-7de3-4d83-8150-813b7b219462 for instance 6ff8b777-591b-48fc-8e08-8722d8a3adca on hv-cinder-82651 Jun 02 13:58:14.153173 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-9480326d-1df2-49c0-acdf-46354bb58a93 req-c9f93778-c92c-4d54-8532-b9b33cd00e14 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049906 Jun 02 13:58:14.159827 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 235/456] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:58:14.196342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-10ab806d-c3b7-4ff3-af56-6902247831e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:14.196342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-10ab806d-c3b7-4ff3-af56-6902247831e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:14.205289 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-10ab806d-c3b7-4ff3-af56-6902247831e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:14.205817 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-10ab806d-c3b7-4ff3-af56-6902247831e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:14.206654 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-10ab806d-c3b7-4ff3-af56-6902247831e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:14.207158 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-10ab806d-c3b7-4ff3-af56-6902247831e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:14.450463 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-10ab806d-c3b7-4ff3-af56-6902247831e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:14.461019 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-10ab806d-c3b7-4ff3-af56-6902247831e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:14.466493 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-10ab806d-c3b7-4ff3-af56-6902247831e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:14.469644 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-10ab806d-c3b7-4ff3-af56-6902247831e0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1744 microversion: 2.20 time: 0.278431 Jun 02 13:58:14.490465 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 222/457] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:14 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1744 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:14.500786 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7dd070fb-8087-4330-9a60-ec7bdd0257f4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:14.501956 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7dd070fb-8087-4330-9a60-ec7bdd0257f4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:14.509832 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7dd070fb-8087-4330-9a60-ec7bdd0257f4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:14.512578 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7dd070fb-8087-4330-9a60-ec7bdd0257f4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:14.515245 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7dd070fb-8087-4330-9a60-ec7bdd0257f4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:14.515856 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7dd070fb-8087-4330-9a60-ec7bdd0257f4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:14.755204 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7dd070fb-8087-4330-9a60-ec7bdd0257f4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:14.767148 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7dd070fb-8087-4330-9a60-ec7bdd0257f4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1445 microversion: 2.1 time: 0.268532 Jun 02 13:58:14.779398 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 236/458] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:14 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1445 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:14.785507 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fafb7f93-e7a0-4b7e-af56-2f6e3dfe8187 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:14.786281 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-fafb7f93-e7a0-4b7e-af56-2f6e3dfe8187 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:14.795303 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fafb7f93-e7a0-4b7e-af56-2f6e3dfe8187 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:14.795938 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fafb7f93-e7a0-4b7e-af56-2f6e3dfe8187 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:14.796933 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fafb7f93-e7a0-4b7e-af56-2f6e3dfe8187 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:14.798124 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fafb7f93-e7a0-4b7e-af56-2f6e3dfe8187 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:15.036164 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-fafb7f93-e7a0-4b7e-af56-2f6e3dfe8187 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:15.046141 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-fafb7f93-e7a0-4b7e-af56-2f6e3dfe8187 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1445 microversion: 2.1 time: 0.264639 Jun 02 13:58:15.052213 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 223/459] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:14 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1445 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:15.490923 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a6d7c41d-994b-4642-8a94-bdc48858240c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:15.491536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a6d7c41d-994b-4642-8a94-bdc48858240c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:15.497712 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a6d7c41d-994b-4642-8a94-bdc48858240c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:15.498155 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a6d7c41d-994b-4642-8a94-bdc48858240c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:15.498912 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a6d7c41d-994b-4642-8a94-bdc48858240c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:15.499344 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a6d7c41d-994b-4642-8a94-bdc48858240c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:15.657982 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a6d7c41d-994b-4642-8a94-bdc48858240c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:15.666801 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a6d7c41d-994b-4642-8a94-bdc48858240c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:15.668316 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a6d7c41d-994b-4642-8a94-bdc48858240c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:15.669562 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a6d7c41d-994b-4642-8a94-bdc48858240c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1744 microversion: 2.20 time: 0.183383 Jun 02 13:58:15.670130 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 237/460] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:15 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:16.690123 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e7a373e4-1c4d-41cc-8b34-feb248eae2c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:16.697352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e7a373e4-1c4d-41cc-8b34-feb248eae2c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:16.706012 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7a373e4-1c4d-41cc-8b34-feb248eae2c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:16.706965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7a373e4-1c4d-41cc-8b34-feb248eae2c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:16.707970 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7a373e4-1c4d-41cc-8b34-feb248eae2c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:16.713335 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7a373e4-1c4d-41cc-8b34-feb248eae2c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:16.983748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e7a373e4-1c4d-41cc-8b34-feb248eae2c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:16.996704 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e7a373e4-1c4d-41cc-8b34-feb248eae2c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:16.998650 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e7a373e4-1c4d-41cc-8b34-feb248eae2c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:16.999830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e7a373e4-1c4d-41cc-8b34-feb248eae2c5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1744 microversion: 2.20 time: 0.316290 Jun 02 13:58:17.000391 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 224/461] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:16 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1744 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:18.021728 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4b9f5a9d-a2d4-4eb0-ae36-439e3c73512e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:18.023122 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4b9f5a9d-a2d4-4eb0-ae36-439e3c73512e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:18.032007 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4b9f5a9d-a2d4-4eb0-ae36-439e3c73512e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:18.032687 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4b9f5a9d-a2d4-4eb0-ae36-439e3c73512e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:18.033765 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4b9f5a9d-a2d4-4eb0-ae36-439e3c73512e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:18.034360 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4b9f5a9d-a2d4-4eb0-ae36-439e3c73512e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:18.588225 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4b9f5a9d-a2d4-4eb0-ae36-439e3c73512e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:18.612862 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-9c7f3683-4c1a-4b99-ae2b-52649c95f7a6 req-cefd62d9-225d-4ded-a84f-68e428997e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4253a95d-5443-4a20-9a10-621c058e8674", "tag": "7e76fdd4-e430-47ed-aee9-504128683d44"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:58:18.629854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4b9f5a9d-a2d4-4eb0-ae36-439e3c73512e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:18.634709 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4b9f5a9d-a2d4-4eb0-ae36-439e3c73512e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:18.653076 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-9c7f3683-4c1a-4b99-ae2b-52649c95f7a6 req-cefd62d9-225d-4ded-a84f-68e428997e76 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:18.657059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4b9f5a9d-a2d4-4eb0-ae36-439e3c73512e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.640071 Jun 02 13:58:18.657302 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-9c7f3683-4c1a-4b99-ae2b-52649c95f7a6 req-cefd62d9-225d-4ded-a84f-68e428997e76 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:18.662507 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 238/462] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:18 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:18.680348 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-9c7f3683-4c1a-4b99-ae2b-52649c95f7a6 req-cefd62d9-225d-4ded-a84f-68e428997e76 service nova] Creating event network-changed:7e76fdd4-e430-47ed-aee9-504128683d44 for instance 4253a95d-5443-4a20-9a10-621c058e8674 on hv-cinder-82651 Jun 02 13:58:18.688093 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-9c7f3683-4c1a-4b99-ae2b-52649c95f7a6 req-cefd62d9-225d-4ded-a84f-68e428997e76 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112642 Jun 02 13:58:18.695746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 225/463] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:58:19.685197 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-dfbe8977-1756-4daa-bc97-f8683f4b754d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:19.685777 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-dfbe8977-1756-4daa-bc97-f8683f4b754d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:19.698677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dfbe8977-1756-4daa-bc97-f8683f4b754d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:19.703316 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dfbe8977-1756-4daa-bc97-f8683f4b754d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:19.703316 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dfbe8977-1756-4daa-bc97-f8683f4b754d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:19.703316 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dfbe8977-1756-4daa-bc97-f8683f4b754d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:19.883050 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-dfbe8977-1756-4daa-bc97-f8683f4b754d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:19.903283 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-dfbe8977-1756-4daa-bc97-f8683f4b754d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:19.905078 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-dfbe8977-1756-4daa-bc97-f8683f4b754d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:19.906898 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-dfbe8977-1756-4daa-bc97-f8683f4b754d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.226292 Jun 02 13:58:19.907933 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 239/464] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:19 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:20.618743 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d9963993-b300-4923-bc0e-15ef25d63759 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Action: 'create', calling method: .version_select at 0x7fb71af611f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1757607995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNv07HXatJUmz2etaXEBTQDBzcGJ3+7stux4EaCObCkAb7AfhJSCT1OulaZBUU20HtXdlmLOUFzxdD0jcgDjH3WeO5b4tP/YOZcpsBl6g4HoECAFVUegRTZPs4olHENlw=="}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:58:20.637412 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-d9963993-b300-4923-bc0e-15ef25d63759 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Getting quotas for project 93c4473545ff46bbaa857263e85af2f1. Resources: {'key_pairs'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:58:20.641730 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-d9963993-b300-4923-bc0e-15ef25d63759 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Getting quotas for user 3c80d109325d4a4b9e9e97dfaccc5785 and project 93c4473545ff46bbaa857263e85af2f1. Resources: {'key_pairs'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:58:20.761509 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d9963993-b300-4923-bc0e-15ef25d63759 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.147691 Jun 02 13:58:20.762406 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 226/465] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 2 13:58:20 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:58:20.815093 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1260419770", "imageRef": "95c9541d-5bfb-4775-80a8-c69b23abe9b2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1757607995", "networks": [{"uuid": "5988aad1-6f52-47b2-833a-83d3b0d268cd"}]}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:58:20.866586 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.network.neutron [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] validate_networks() for [('5988aad1-6f52-47b2-833a-83d3b0d268cd', None, None, None, None, None)] {{(pid=118316) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:58:20.928021 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b4e4a738-2cee-465a-8c4a-4670dfc3cbc0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:20.928784 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b4e4a738-2cee-465a-8c4a-4670dfc3cbc0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:20.935741 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b4e4a738-2cee-465a-8c4a-4670dfc3cbc0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:20.936426 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b4e4a738-2cee-465a-8c4a-4670dfc3cbc0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:20.936991 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b4e4a738-2cee-465a-8c4a-4670dfc3cbc0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:20.937325 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b4e4a738-2cee-465a-8c4a-4670dfc3cbc0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:21.176976 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b4e4a738-2cee-465a-8c4a-4670dfc3cbc0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:21.185273 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b4e4a738-2cee-465a-8c4a-4670dfc3cbc0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:21.186808 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b4e4a738-2cee-465a-8c4a-4670dfc3cbc0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:21.187983 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b4e4a738-2cee-465a-8c4a-4670dfc3cbc0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.264926 Jun 02 13:58:21.188756 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 227/466] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:20 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:58:21.332508 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Flavor limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:58:21.332930 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Image limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:58:21.333407 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Flavor pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:58:21.334724 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Image pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:58:21.335412 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:58:21.351097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:21.351781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:21.352995 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:21.353430 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:21.377729 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Getting quotas for project 93c4473545ff46bbaa857263e85af2f1. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:58:21.384615 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Getting quotas for user 3c80d109325d4a4b9e9e97dfaccc5785 and project 93c4473545ff46bbaa857263e85af2f1. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:58:21.398609 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Going to run 1 instances... {{(pid=118316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:58:21.401565 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c9541d-5bfb-4775-80a8-c69b23abe9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:58:21.544117 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-bdad5aea-0c37-41bc-9ed8-ef5014f5fcbe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732805 Jun 02 13:58:21.549987 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 240/467] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 13:58:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:58:21.556256 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-af2139ea-bec2-4620-ae19-fe3272dc1ca9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:21.556904 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-af2139ea-bec2-4620-ae19-fe3272dc1ca9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:21.620952 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-af2139ea-bec2-4620-ae19-fe3272dc1ca9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:21.630118 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-af2139ea-bec2-4620-ae19-fe3272dc1ca9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1259 microversion: 2.1 time: 0.078868 Jun 02 13:58:21.632886 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 228/468] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:21 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:22.207388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2fc5300e-867f-4efd-acb1-79c2328e3fb5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:22.208089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2fc5300e-867f-4efd-acb1-79c2328e3fb5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:22.216316 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2fc5300e-867f-4efd-acb1-79c2328e3fb5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:22.222582 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2fc5300e-867f-4efd-acb1-79c2328e3fb5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:22.223503 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2fc5300e-867f-4efd-acb1-79c2328e3fb5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:22.223943 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2fc5300e-867f-4efd-acb1-79c2328e3fb5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:22.368701 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2fc5300e-867f-4efd-acb1-79c2328e3fb5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:22.378279 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2fc5300e-867f-4efd-acb1-79c2328e3fb5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:22.379795 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2fc5300e-867f-4efd-acb1-79c2328e3fb5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:22.381537 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2fc5300e-867f-4efd-acb1-79c2328e3fb5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.178584 Jun 02 13:58:22.382421 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 241/469] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:22 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:22.649289 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-659b60ae-61aa-41c6-aa98-0ada637e0465 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:22.650629 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-659b60ae-61aa-41c6-aa98-0ada637e0465 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:22.710978 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-659b60ae-61aa-41c6-aa98-0ada637e0465 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:22.719007 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-659b60ae-61aa-41c6-aa98-0ada637e0465 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1259 microversion: 2.1 time: 0.074568 Jun 02 13:58:22.719663 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 229/470] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:22 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1259 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:23.400495 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-22f4227f-12e2-4e74-bfc1-ad8d1b89b337 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:23.401996 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-22f4227f-12e2-4e74-bfc1-ad8d1b89b337 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:23.410326 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-22f4227f-12e2-4e74-bfc1-ad8d1b89b337 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:23.410967 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-22f4227f-12e2-4e74-bfc1-ad8d1b89b337 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:23.414519 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-22f4227f-12e2-4e74-bfc1-ad8d1b89b337 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:23.415902 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-22f4227f-12e2-4e74-bfc1-ad8d1b89b337 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:23.438348 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:23.573325 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-22f4227f-12e2-4e74-bfc1-ad8d1b89b337 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:23.582684 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-22f4227f-12e2-4e74-bfc1-ad8d1b89b337 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:23.585160 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-22f4227f-12e2-4e74-bfc1-ad8d1b89b337 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:23.586400 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-22f4227f-12e2-4e74-bfc1-ad8d1b89b337 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.190812 Jun 02 13:58:23.587164 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 242/471] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:23 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:23.738072 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-64bbb3e4-62f8-42a2-b644-d9d093f0d95e tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:23.738876 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-64bbb3e4-62f8-42a2-b644-d9d093f0d95e tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:23.745900 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-64bbb3e4-62f8-42a2-b644-d9d093f0d95e tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:23.746351 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-64bbb3e4-62f8-42a2-b644-d9d093f0d95e tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:23.747101 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-64bbb3e4-62f8-42a2-b644-d9d093f0d95e tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:23.747552 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-64bbb3e4-62f8-42a2-b644-d9d093f0d95e tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:23.808835 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-64bbb3e4-62f8-42a2-b644-d9d093f0d95e tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:23.817105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-64bbb3e4-62f8-42a2-b644-d9d093f0d95e tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1263 microversion: 2.1 time: 0.082979 Jun 02 13:58:23.817736 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 230/472] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:23 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:24.605445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-19872f31-3e8e-4fb2-bd41-2d3de90a80a9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:24.606882 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-19872f31-3e8e-4fb2-bd41-2d3de90a80a9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:24.613323 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-19872f31-3e8e-4fb2-bd41-2d3de90a80a9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:24.613786 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-19872f31-3e8e-4fb2-bd41-2d3de90a80a9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:24.614534 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-19872f31-3e8e-4fb2-bd41-2d3de90a80a9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:24.614984 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-19872f31-3e8e-4fb2-bd41-2d3de90a80a9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:24.796337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-19872f31-3e8e-4fb2-bd41-2d3de90a80a9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:24.805790 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-19872f31-3e8e-4fb2-bd41-2d3de90a80a9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:24.808297 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-19872f31-3e8e-4fb2-bd41-2d3de90a80a9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:24.809794 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-19872f31-3e8e-4fb2-bd41-2d3de90a80a9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.208302 Jun 02 13:58:24.810351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 243/473] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:24 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:24.835452 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f128df37-2fb7-403b-aab5-7a414c0f22de tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:24.836060 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f128df37-2fb7-403b-aab5-7a414c0f22de tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:24.842719 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f128df37-2fb7-403b-aab5-7a414c0f22de tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:24.843159 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f128df37-2fb7-403b-aab5-7a414c0f22de tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:24.843909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f128df37-2fb7-403b-aab5-7a414c0f22de tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:24.844649 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f128df37-2fb7-403b-aab5-7a414c0f22de tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:24.848631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=100 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:24.907253 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f128df37-2fb7-403b-aab5-7a414c0f22de tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:24.917386 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f128df37-2fb7-403b-aab5-7a414c0f22de tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1319 microversion: 2.1 time: 0.086401 Jun 02 13:58:24.928455 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 231/474] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:24 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1319 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:25.829369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a3756477-bfef-4607-b942-398dd1508880 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:25.829991 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a3756477-bfef-4607-b942-398dd1508880 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:25.842933 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a3756477-bfef-4607-b942-398dd1508880 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:25.843524 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a3756477-bfef-4607-b942-398dd1508880 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:25.844375 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a3756477-bfef-4607-b942-398dd1508880 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:25.844933 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a3756477-bfef-4607-b942-398dd1508880 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:25.938043 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e2b5e2d4-8a37-491b-8271-c5befdc5c72d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:25.938913 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e2b5e2d4-8a37-491b-8271-c5befdc5c72d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:25.975080 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e2b5e2d4-8a37-491b-8271-c5befdc5c72d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:25.979774 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e2b5e2d4-8a37-491b-8271-c5befdc5c72d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:25.980879 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e2b5e2d4-8a37-491b-8271-c5befdc5c72d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:25.981468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e2b5e2d4-8a37-491b-8271-c5befdc5c72d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:26.150565 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a3756477-bfef-4607-b942-398dd1508880 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:26.160576 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a3756477-bfef-4607-b942-398dd1508880 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:26.169036 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a3756477-bfef-4607-b942-398dd1508880 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:26.170272 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a3756477-bfef-4607-b942-398dd1508880 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.344786 Jun 02 13:58:26.181775 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 244/475] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:25 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:26.291783 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e2b5e2d4-8a37-491b-8271-c5befdc5c72d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:26.300798 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e2b5e2d4-8a37-491b-8271-c5befdc5c72d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.368427 Jun 02 13:58:26.301924 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 232/476] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:25 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:27.194107 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d675855b-3700-4c4f-8f33-c3ac479eff5f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:27.194848 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d675855b-3700-4c4f-8f33-c3ac479eff5f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:27.201667 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d675855b-3700-4c4f-8f33-c3ac479eff5f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:27.207763 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d675855b-3700-4c4f-8f33-c3ac479eff5f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:27.207763 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d675855b-3700-4c4f-8f33-c3ac479eff5f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:27.207763 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d675855b-3700-4c4f-8f33-c3ac479eff5f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:27.317429 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-011f23c3-7628-4f8a-9fba-894a8bbc4cd7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:27.318466 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-011f23c3-7628-4f8a-9fba-894a8bbc4cd7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:27.329495 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-011f23c3-7628-4f8a-9fba-894a8bbc4cd7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:27.334475 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-011f23c3-7628-4f8a-9fba-894a8bbc4cd7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:27.334475 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-011f23c3-7628-4f8a-9fba-894a8bbc4cd7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:27.334475 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-011f23c3-7628-4f8a-9fba-894a8bbc4cd7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:27.346804 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d675855b-3700-4c4f-8f33-c3ac479eff5f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:27.356865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d675855b-3700-4c4f-8f33-c3ac479eff5f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:27.359231 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d675855b-3700-4c4f-8f33-c3ac479eff5f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:27.360852 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d675855b-3700-4c4f-8f33-c3ac479eff5f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.174531 Jun 02 13:58:27.372875 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 245/477] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:27 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:27.508975 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-011f23c3-7628-4f8a-9fba-894a8bbc4cd7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:27.517647 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-011f23c3-7628-4f8a-9fba-894a8bbc4cd7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.203777 Jun 02 13:58:27.527376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 233/478] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:27 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:58:28.379377 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-64e0f8c6-3e38-4121-90cc-a0d4b6abf988 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:28.380975 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-64e0f8c6-3e38-4121-90cc-a0d4b6abf988 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:28.391791 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-64e0f8c6-3e38-4121-90cc-a0d4b6abf988 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:28.392813 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-64e0f8c6-3e38-4121-90cc-a0d4b6abf988 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:28.394506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-64e0f8c6-3e38-4121-90cc-a0d4b6abf988 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:28.395556 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-64e0f8c6-3e38-4121-90cc-a0d4b6abf988 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:28.535715 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-81ff78e4-1260-4ef3-bd07-17fd66afefc0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:28.537153 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-81ff78e4-1260-4ef3-bd07-17fd66afefc0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:28.545246 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-81ff78e4-1260-4ef3-bd07-17fd66afefc0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:28.545706 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-81ff78e4-1260-4ef3-bd07-17fd66afefc0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:28.550881 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-81ff78e4-1260-4ef3-bd07-17fd66afefc0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:28.550881 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-81ff78e4-1260-4ef3-bd07-17fd66afefc0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:28.564135 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-64e0f8c6-3e38-4121-90cc-a0d4b6abf988 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:28.581553 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-64e0f8c6-3e38-4121-90cc-a0d4b6abf988 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:28.583030 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-64e0f8c6-3e38-4121-90cc-a0d4b6abf988 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:28.584472 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-64e0f8c6-3e38-4121-90cc-a0d4b6abf988 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.209086 Jun 02 13:58:28.585236 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 246/479] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:28 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:28.730186 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-81ff78e4-1260-4ef3-bd07-17fd66afefc0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:28.737559 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-81ff78e4-1260-4ef3-bd07-17fd66afefc0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.206103 Jun 02 13:58:28.738108 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 234/480] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:28 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:29.604077 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-1847b239-5940-42f7-a501-cca51371058c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:29.604930 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-1847b239-5940-42f7-a501-cca51371058c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:29.611273 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1847b239-5940-42f7-a501-cca51371058c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:29.611800 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1847b239-5940-42f7-a501-cca51371058c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:29.612683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1847b239-5940-42f7-a501-cca51371058c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:29.613188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1847b239-5940-42f7-a501-cca51371058c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:29.758665 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1847b239-5940-42f7-a501-cca51371058c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:29.763026 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-8d67b1ed-992c-4f22-a23a-cb71e46d8aa2 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:29.764276 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-8d67b1ed-992c-4f22-a23a-cb71e46d8aa2 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:29.767182 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1847b239-5940-42f7-a501-cca51371058c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:29.769952 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1847b239-5940-42f7-a501-cca51371058c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:29.771968 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-1847b239-5940-42f7-a501-cca51371058c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.172255 Jun 02 13:58:29.772988 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8d67b1ed-992c-4f22-a23a-cb71e46d8aa2 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:29.773682 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8d67b1ed-992c-4f22-a23a-cb71e46d8aa2 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:29.774705 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8d67b1ed-992c-4f22-a23a-cb71e46d8aa2 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:29.775505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8d67b1ed-992c-4f22-a23a-cb71e46d8aa2 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:29.783682 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 247/481] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:29 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:29.923113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-8d67b1ed-992c-4f22-a23a-cb71e46d8aa2 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:29.931545 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-8d67b1ed-992c-4f22-a23a-cb71e46d8aa2 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.179010 Jun 02 13:58:29.932527 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 235/482] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:29 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:30.791127 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7ef71c11-9f8a-4d01-b794-2fdebff639f0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:30.791784 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7ef71c11-9f8a-4d01-b794-2fdebff639f0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:30.797823 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ef71c11-9f8a-4d01-b794-2fdebff639f0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:30.798255 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ef71c11-9f8a-4d01-b794-2fdebff639f0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:30.799001 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ef71c11-9f8a-4d01-b794-2fdebff639f0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:30.799438 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ef71c11-9f8a-4d01-b794-2fdebff639f0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:30.953049 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1094104b-b0ef-49e3-9ad4-844a0485a440 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:30.953777 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1094104b-b0ef-49e3-9ad4-844a0485a440 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:30.959846 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7ef71c11-9f8a-4d01-b794-2fdebff639f0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:30.966814 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1094104b-b0ef-49e3-9ad4-844a0485a440 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:30.967499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1094104b-b0ef-49e3-9ad4-844a0485a440 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:30.968279 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7ef71c11-9f8a-4d01-b794-2fdebff639f0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:30.968847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1094104b-b0ef-49e3-9ad4-844a0485a440 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:30.970077 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1094104b-b0ef-49e3-9ad4-844a0485a440 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:30.970231 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7ef71c11-9f8a-4d01-b794-2fdebff639f0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:30.971317 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7ef71c11-9f8a-4d01-b794-2fdebff639f0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.184790 Jun 02 13:58:30.983537 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 248/483] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:30 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:58:31.156453 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1094104b-b0ef-49e3-9ad4-844a0485a440 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:31.166599 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1094104b-b0ef-49e3-9ad4-844a0485a440 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.219178 Jun 02 13:58:31.167763 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 236/484] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:30 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:31.990661 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-085bc0ad-ae70-47af-a7de-4097355634c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:31.991383 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-085bc0ad-ae70-47af-a7de-4097355634c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:31.993191 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:31.994526 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=6 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:32.000054 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-085bc0ad-ae70-47af-a7de-4097355634c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:32.001825 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-085bc0ad-ae70-47af-a7de-4097355634c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:32.001825 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-085bc0ad-ae70-47af-a7de-4097355634c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:32.002607 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-085bc0ad-ae70-47af-a7de-4097355634c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:32.168187 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-085bc0ad-ae70-47af-a7de-4097355634c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:32.177516 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-085bc0ad-ae70-47af-a7de-4097355634c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:32.184297 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-085bc0ad-ae70-47af-a7de-4097355634c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:32.184297 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-085bc0ad-ae70-47af-a7de-4097355634c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.193917 Jun 02 13:58:32.184297 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 249/485] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:31 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:32.184638 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4c4daac4-9e15-4160-9671-993dfb0c7875 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:32.187041 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4c4daac4-9e15-4160-9671-993dfb0c7875 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:32.194536 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4c4daac4-9e15-4160-9671-993dfb0c7875 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:32.194994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4c4daac4-9e15-4160-9671-993dfb0c7875 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:32.195819 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4c4daac4-9e15-4160-9671-993dfb0c7875 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:32.196246 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4c4daac4-9e15-4160-9671-993dfb0c7875 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:32.345193 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4c4daac4-9e15-4160-9671-993dfb0c7875 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:32.715336 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=8 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:32.999319 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4c4daac4-9e15-4160-9671-993dfb0c7875 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.819845 Jun 02 13:58:33.000175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 237/486] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:32 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:33.200389 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5c7411a5-0d0c-4e16-b51a-a91b1a4d3ff7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:33.201000 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-5c7411a5-0d0c-4e16-b51a-a91b1a4d3ff7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:33.209916 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5c7411a5-0d0c-4e16-b51a-a91b1a4d3ff7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:33.212518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5c7411a5-0d0c-4e16-b51a-a91b1a4d3ff7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:33.213323 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5c7411a5-0d0c-4e16-b51a-a91b1a4d3ff7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:33.213754 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5c7411a5-0d0c-4e16-b51a-a91b1a4d3ff7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:33.463015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5c7411a5-0d0c-4e16-b51a-a91b1a4d3ff7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:33.474186 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5c7411a5-0d0c-4e16-b51a-a91b1a4d3ff7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:33.483666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5c7411a5-0d0c-4e16-b51a-a91b1a4d3ff7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:33.485532 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5c7411a5-0d0c-4e16-b51a-a91b1a4d3ff7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.289611 Jun 02 13:58:33.514785 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 250/487] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:33 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:34.017917 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-76717fd8-eb68-4ce1-98c9-f54b3dcc1d3c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:34.018490 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-76717fd8-eb68-4ce1-98c9-f54b3dcc1d3c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:34.038059 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-76717fd8-eb68-4ce1-98c9-f54b3dcc1d3c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:34.038825 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-76717fd8-eb68-4ce1-98c9-f54b3dcc1d3c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:34.039946 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-76717fd8-eb68-4ce1-98c9-f54b3dcc1d3c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:34.040528 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-76717fd8-eb68-4ce1-98c9-f54b3dcc1d3c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:34.193408 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-76717fd8-eb68-4ce1-98c9-f54b3dcc1d3c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:34.201401 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-76717fd8-eb68-4ce1-98c9-f54b3dcc1d3c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.188683 Jun 02 13:58:34.202319 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 238/488] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:34 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:34.333248 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-0576da32-f836-4ccd-ba6e-2996ba663499 req-4f162cd9-49f9-4fc7-8758-6b04b0cfdd5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "783eae57-62e0-4101-ae12-14b73c9f87db", "tag": "206884cb-c7bb-4476-9320-75dc2245d246"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:58:34.343839 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-0576da32-f836-4ccd-ba6e-2996ba663499 req-4f162cd9-49f9-4fc7-8758-6b04b0cfdd5c service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:34.343839 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-0576da32-f836-4ccd-ba6e-2996ba663499 req-4f162cd9-49f9-4fc7-8758-6b04b0cfdd5c service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:34.354313 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-0576da32-f836-4ccd-ba6e-2996ba663499 req-4f162cd9-49f9-4fc7-8758-6b04b0cfdd5c service nova] Creating event network-changed:206884cb-c7bb-4476-9320-75dc2245d246 for instance 783eae57-62e0-4101-ae12-14b73c9f87db on hv-cinder-82651 Jun 02 13:58:34.359632 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-0576da32-f836-4ccd-ba6e-2996ba663499 req-4f162cd9-49f9-4fc7-8758-6b04b0cfdd5c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030064 Jun 02 13:58:34.360237 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 251/489] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:58:34.506528 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a3bdcf1f-c552-47b0-a128-a25ad711c144 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:34.506528 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a3bdcf1f-c552-47b0-a128-a25ad711c144 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:34.513627 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a3bdcf1f-c552-47b0-a128-a25ad711c144 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:34.520970 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a3bdcf1f-c552-47b0-a128-a25ad711c144 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:34.522036 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a3bdcf1f-c552-47b0-a128-a25ad711c144 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:34.522819 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a3bdcf1f-c552-47b0-a128-a25ad711c144 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:34.700857 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a3bdcf1f-c552-47b0-a128-a25ad711c144 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:34.710268 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a3bdcf1f-c552-47b0-a128-a25ad711c144 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:34.712035 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a3bdcf1f-c552-47b0-a128-a25ad711c144 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:34.713250 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a3bdcf1f-c552-47b0-a128-a25ad711c144 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.211638 Jun 02 13:58:34.713800 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 239/490] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:34 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:35.219709 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9d544992-8da3-4286-bdd9-4a2aa87bfab9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:35.220471 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9d544992-8da3-4286-bdd9-4a2aa87bfab9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:35.227046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d544992-8da3-4286-bdd9-4a2aa87bfab9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:35.227540 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d544992-8da3-4286-bdd9-4a2aa87bfab9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:35.228295 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d544992-8da3-4286-bdd9-4a2aa87bfab9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:35.228884 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d544992-8da3-4286-bdd9-4a2aa87bfab9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:35.368768 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9d544992-8da3-4286-bdd9-4a2aa87bfab9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:35.376490 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9d544992-8da3-4286-bdd9-4a2aa87bfab9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.161076 Jun 02 13:58:35.377072 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 252/491] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:35 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:35.731749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-6d1a708e-fee5-497e-87e1-414b46123358 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:35.732538 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-6d1a708e-fee5-497e-87e1-414b46123358 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:35.739387 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6d1a708e-fee5-497e-87e1-414b46123358 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:35.739927 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6d1a708e-fee5-497e-87e1-414b46123358 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:35.740868 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6d1a708e-fee5-497e-87e1-414b46123358 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:35.741363 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6d1a708e-fee5-497e-87e1-414b46123358 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:35.881102 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6d1a708e-fee5-497e-87e1-414b46123358 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:35.889609 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6d1a708e-fee5-497e-87e1-414b46123358 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:35.891139 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6d1a708e-fee5-497e-87e1-414b46123358 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:35.892319 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-6d1a708e-fee5-497e-87e1-414b46123358 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.164501 Jun 02 13:58:35.897470 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 240/492] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:35 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:36.394628 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f6be697c-d474-4108-b541-03ebbff4c444 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:36.397156 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f6be697c-d474-4108-b541-03ebbff4c444 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:36.404282 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:36.406606 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f6be697c-d474-4108-b541-03ebbff4c444 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:36.407246 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f6be697c-d474-4108-b541-03ebbff4c444 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:36.408192 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f6be697c-d474-4108-b541-03ebbff4c444 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:36.408811 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f6be697c-d474-4108-b541-03ebbff4c444 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:36.555387 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f6be697c-d474-4108-b541-03ebbff4c444 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:36.563022 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f6be697c-d474-4108-b541-03ebbff4c444 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.172323 Jun 02 13:58:36.563594 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 253/493] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:36 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:36.911352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4d5d99de-7dc1-44cf-931c-66af660bbb1a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:36.911973 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4d5d99de-7dc1-44cf-931c-66af660bbb1a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:36.914679 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:36.919467 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4d5d99de-7dc1-44cf-931c-66af660bbb1a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:36.919913 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4d5d99de-7dc1-44cf-931c-66af660bbb1a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:36.920733 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4d5d99de-7dc1-44cf-931c-66af660bbb1a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:36.921245 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4d5d99de-7dc1-44cf-931c-66af660bbb1a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:37.064966 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4d5d99de-7dc1-44cf-931c-66af660bbb1a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:37.073490 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4d5d99de-7dc1-44cf-931c-66af660bbb1a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:37.075270 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4d5d99de-7dc1-44cf-931c-66af660bbb1a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:37.076538 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4d5d99de-7dc1-44cf-931c-66af660bbb1a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.169106 Jun 02 13:58:37.077100 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 241/494] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:36 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:37.582482 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-17ae34ea-543b-45fd-a8a6-5fe0f97565b7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:37.583096 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-17ae34ea-543b-45fd-a8a6-5fe0f97565b7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:37.589297 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-17ae34ea-543b-45fd-a8a6-5fe0f97565b7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:37.589738 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-17ae34ea-543b-45fd-a8a6-5fe0f97565b7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:37.590487 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-17ae34ea-543b-45fd-a8a6-5fe0f97565b7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:37.590919 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-17ae34ea-543b-45fd-a8a6-5fe0f97565b7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:37.722727 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-17ae34ea-543b-45fd-a8a6-5fe0f97565b7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:37.732323 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-17ae34ea-543b-45fd-a8a6-5fe0f97565b7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.153185 Jun 02 13:58:37.732664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 254/495] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:37 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:38.094501 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a0e314d0-b212-49ca-99f9-d74e0fb6fede tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:38.095418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a0e314d0-b212-49ca-99f9-d74e0fb6fede tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:38.111756 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a0e314d0-b212-49ca-99f9-d74e0fb6fede tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:38.112208 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a0e314d0-b212-49ca-99f9-d74e0fb6fede tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:38.113018 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a0e314d0-b212-49ca-99f9-d74e0fb6fede tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:38.113460 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a0e314d0-b212-49ca-99f9-d74e0fb6fede tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:38.256956 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a0e314d0-b212-49ca-99f9-d74e0fb6fede tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:38.265510 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a0e314d0-b212-49ca-99f9-d74e0fb6fede tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:38.267172 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a0e314d0-b212-49ca-99f9-d74e0fb6fede tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:38.268508 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a0e314d0-b212-49ca-99f9-d74e0fb6fede tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.178734 Jun 02 13:58:38.269286 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 242/496] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:38 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:38.749267 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0e73d1c9-ceb3-4d1d-844e-068a92907b5d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:38.749846 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0e73d1c9-ceb3-4d1d-844e-068a92907b5d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:38.756188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0e73d1c9-ceb3-4d1d-844e-068a92907b5d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:38.756589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0e73d1c9-ceb3-4d1d-844e-068a92907b5d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:38.757351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0e73d1c9-ceb3-4d1d-844e-068a92907b5d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:38.757766 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0e73d1c9-ceb3-4d1d-844e-068a92907b5d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:38.895751 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0e73d1c9-ceb3-4d1d-844e-068a92907b5d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:38.903656 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0e73d1c9-ceb3-4d1d-844e-068a92907b5d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.158221 Jun 02 13:58:38.904213 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 255/497] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:38 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:39.288327 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4183a66c-63a4-4ca2-aba1-1330a7c50c9e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:39.313613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4183a66c-63a4-4ca2-aba1-1330a7c50c9e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:39.313613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4183a66c-63a4-4ca2-aba1-1330a7c50c9e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:39.313613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4183a66c-63a4-4ca2-aba1-1330a7c50c9e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:39.313613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4183a66c-63a4-4ca2-aba1-1330a7c50c9e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:39.314000 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4183a66c-63a4-4ca2-aba1-1330a7c50c9e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:39.438835 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4183a66c-63a4-4ca2-aba1-1330a7c50c9e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:39.453916 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4183a66c-63a4-4ca2-aba1-1330a7c50c9e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:39.456006 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4183a66c-63a4-4ca2-aba1-1330a7c50c9e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:39.457622 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4183a66c-63a4-4ca2-aba1-1330a7c50c9e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.174144 Jun 02 13:58:39.458382 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 243/498] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:39 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:39.920637 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-40db0f4c-cf52-4cc8-ae40-673ba4f137fe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:39.921501 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-40db0f4c-cf52-4cc8-ae40-673ba4f137fe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:39.930128 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-40db0f4c-cf52-4cc8-ae40-673ba4f137fe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:39.931159 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-40db0f4c-cf52-4cc8-ae40-673ba4f137fe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:39.932323 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-40db0f4c-cf52-4cc8-ae40-673ba4f137fe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:39.933039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-40db0f4c-cf52-4cc8-ae40-673ba4f137fe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:40.093355 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-40db0f4c-cf52-4cc8-ae40-673ba4f137fe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:40.102098 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-40db0f4c-cf52-4cc8-ae40-673ba4f137fe tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.185301 Jun 02 13:58:40.102752 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 256/499] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:39 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:40.479510 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c648540e-cb61-419d-8f04-72f09c5711c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:40.480133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c648540e-cb61-419d-8f04-72f09c5711c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:40.489113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c648540e-cb61-419d-8f04-72f09c5711c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:40.489113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c648540e-cb61-419d-8f04-72f09c5711c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:40.489113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c648540e-cb61-419d-8f04-72f09c5711c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:40.489707 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c648540e-cb61-419d-8f04-72f09c5711c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:40.616397 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c648540e-cb61-419d-8f04-72f09c5711c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:40.625279 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c648540e-cb61-419d-8f04-72f09c5711c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:40.627094 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c648540e-cb61-419d-8f04-72f09c5711c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:40.628957 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c648540e-cb61-419d-8f04-72f09c5711c9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.153717 Jun 02 13:58:40.629461 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 244/500] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:40 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:41.119908 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-fd50878d-6adc-48ae-b574-82d055e366ad tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:41.120621 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-fd50878d-6adc-48ae-b574-82d055e366ad tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:41.126945 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fd50878d-6adc-48ae-b574-82d055e366ad tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:41.127387 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fd50878d-6adc-48ae-b574-82d055e366ad tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:41.128132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fd50878d-6adc-48ae-b574-82d055e366ad tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:41.128598 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fd50878d-6adc-48ae-b574-82d055e366ad tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:41.259691 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-fd50878d-6adc-48ae-b574-82d055e366ad tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:41.267064 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-fd50878d-6adc-48ae-b574-82d055e366ad tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.151886 Jun 02 13:58:41.267629 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 257/501] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:41 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:41.647049 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f3800dd9-0d14-4911-a9c7-6f9dea08549a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:41.647661 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f3800dd9-0d14-4911-a9c7-6f9dea08549a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:41.654800 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f3800dd9-0d14-4911-a9c7-6f9dea08549a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:41.655248 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f3800dd9-0d14-4911-a9c7-6f9dea08549a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:41.656010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f3800dd9-0d14-4911-a9c7-6f9dea08549a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:41.656464 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f3800dd9-0d14-4911-a9c7-6f9dea08549a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:41.784044 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f3800dd9-0d14-4911-a9c7-6f9dea08549a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:41.792864 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f3800dd9-0d14-4911-a9c7-6f9dea08549a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:41.794349 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f3800dd9-0d14-4911-a9c7-6f9dea08549a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:41.795496 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f3800dd9-0d14-4911-a9c7-6f9dea08549a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.152410 Jun 02 13:58:41.796054 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 245/502] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:41 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:42.283932 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0d972273-b438-401a-a7d6-648ace4d4da3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:42.284589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0d972273-b438-401a-a7d6-648ace4d4da3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:42.291262 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0d972273-b438-401a-a7d6-648ace4d4da3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:42.291704 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0d972273-b438-401a-a7d6-648ace4d4da3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:42.292478 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0d972273-b438-401a-a7d6-648ace4d4da3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:42.292912 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0d972273-b438-401a-a7d6-648ace4d4da3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:42.422097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0d972273-b438-401a-a7d6-648ace4d4da3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:42.430015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0d972273-b438-401a-a7d6-648ace4d4da3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.149327 Jun 02 13:58:42.430723 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 258/503] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:42 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:42.813538 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b5eaec9c-4baa-4c21-8cac-ed990160720f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:42.814289 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b5eaec9c-4baa-4c21-8cac-ed990160720f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:42.820851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b5eaec9c-4baa-4c21-8cac-ed990160720f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:42.821440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b5eaec9c-4baa-4c21-8cac-ed990160720f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:42.822321 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b5eaec9c-4baa-4c21-8cac-ed990160720f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:42.822760 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b5eaec9c-4baa-4c21-8cac-ed990160720f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:42.962966 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b5eaec9c-4baa-4c21-8cac-ed990160720f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:42.971782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b5eaec9c-4baa-4c21-8cac-ed990160720f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:42.974106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b5eaec9c-4baa-4c21-8cac-ed990160720f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:42.975796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b5eaec9c-4baa-4c21-8cac-ed990160720f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.166270 Jun 02 13:58:42.976361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 246/504] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:42 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:43.447468 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4485d51c-43c3-4f94-b0eb-bcd48d08b89d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:43.448076 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4485d51c-43c3-4f94-b0eb-bcd48d08b89d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:43.454321 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4485d51c-43c3-4f94-b0eb-bcd48d08b89d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:43.454796 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4485d51c-43c3-4f94-b0eb-bcd48d08b89d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:43.455544 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4485d51c-43c3-4f94-b0eb-bcd48d08b89d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:43.456007 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4485d51c-43c3-4f94-b0eb-bcd48d08b89d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:43.581667 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4485d51c-43c3-4f94-b0eb-bcd48d08b89d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:43.585042 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:43.589879 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4485d51c-43c3-4f94-b0eb-bcd48d08b89d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.147010 Jun 02 13:58:43.590432 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 259/505] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:43 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:43.995467 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5f82d9ad-a193-4d81-bc07-464166c27bbf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:43.996075 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5f82d9ad-a193-4d81-bc07-464166c27bbf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:44.002618 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f82d9ad-a193-4d81-bc07-464166c27bbf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:44.003044 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f82d9ad-a193-4d81-bc07-464166c27bbf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:44.003809 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f82d9ad-a193-4d81-bc07-464166c27bbf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:44.004238 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5f82d9ad-a193-4d81-bc07-464166c27bbf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:44.138586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5f82d9ad-a193-4d81-bc07-464166c27bbf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:44.141966 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=100 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:44.146643 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5f82d9ad-a193-4d81-bc07-464166c27bbf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:44.148156 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5f82d9ad-a193-4d81-bc07-464166c27bbf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:44.149450 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5f82d9ad-a193-4d81-bc07-464166c27bbf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.158496 Jun 02 13:58:44.152813 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 247/506] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:43 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:44.607241 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7aeb9498-1d4b-4499-9d0d-dc4c622d46fa tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:44.607788 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7aeb9498-1d4b-4499-9d0d-dc4c622d46fa tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:44.613833 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7aeb9498-1d4b-4499-9d0d-dc4c622d46fa tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:44.614269 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7aeb9498-1d4b-4499-9d0d-dc4c622d46fa tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:44.615020 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7aeb9498-1d4b-4499-9d0d-dc4c622d46fa tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:44.615492 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7aeb9498-1d4b-4499-9d0d-dc4c622d46fa tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:44.750552 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7aeb9498-1d4b-4499-9d0d-dc4c622d46fa tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:44.758527 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7aeb9498-1d4b-4499-9d0d-dc4c622d46fa tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.155659 Jun 02 13:58:44.759705 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 260/507] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:44 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:45.168371 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b4f0cebc-3dd9-4127-b716-d04889e42716 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:45.169009 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b4f0cebc-3dd9-4127-b716-d04889e42716 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:45.177359 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b4f0cebc-3dd9-4127-b716-d04889e42716 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:45.177805 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b4f0cebc-3dd9-4127-b716-d04889e42716 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:45.179208 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b4f0cebc-3dd9-4127-b716-d04889e42716 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:45.179703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b4f0cebc-3dd9-4127-b716-d04889e42716 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:45.316775 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b4f0cebc-3dd9-4127-b716-d04889e42716 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:45.325166 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b4f0cebc-3dd9-4127-b716-d04889e42716 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:45.326651 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b4f0cebc-3dd9-4127-b716-d04889e42716 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:45.327791 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b4f0cebc-3dd9-4127-b716-d04889e42716 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1739 microversion: 2.20 time: 0.164227 Jun 02 13:58:45.328369 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 248/508] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:45 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:45.776700 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-1adcab40-7aba-47d8-9cb2-2bfd7a96c0f9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:45.777312 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-1adcab40-7aba-47d8-9cb2-2bfd7a96c0f9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:45.783279 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1adcab40-7aba-47d8-9cb2-2bfd7a96c0f9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:45.783721 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1adcab40-7aba-47d8-9cb2-2bfd7a96c0f9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:45.784488 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1adcab40-7aba-47d8-9cb2-2bfd7a96c0f9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:45.784919 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1adcab40-7aba-47d8-9cb2-2bfd7a96c0f9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:45.910358 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1adcab40-7aba-47d8-9cb2-2bfd7a96c0f9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:45.918087 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-1adcab40-7aba-47d8-9cb2-2bfd7a96c0f9 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.145904 Jun 02 13:58:45.918663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 261/509] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:45 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:46.346438 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c90e1656-7ea0-40fd-a47d-a6a25aab2d35 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:46.347027 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c90e1656-7ea0-40fd-a47d-a6a25aab2d35 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:46.354069 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c90e1656-7ea0-40fd-a47d-a6a25aab2d35 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:46.354516 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c90e1656-7ea0-40fd-a47d-a6a25aab2d35 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:46.355266 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c90e1656-7ea0-40fd-a47d-a6a25aab2d35 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:46.355693 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c90e1656-7ea0-40fd-a47d-a6a25aab2d35 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:46.483358 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c90e1656-7ea0-40fd-a47d-a6a25aab2d35 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:46.491437 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c90e1656-7ea0-40fd-a47d-a6a25aab2d35 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:46.493050 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c90e1656-7ea0-40fd-a47d-a6a25aab2d35 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:46.494967 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c90e1656-7ea0-40fd-a47d-a6a25aab2d35 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1721 microversion: 2.20 time: 0.152442 Jun 02 13:58:46.495526 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 249/510] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:46 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:46.935770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a1426064-e1ff-42c4-8d61-15422e875768 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:46.936678 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a1426064-e1ff-42c4-8d61-15422e875768 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:46.943974 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a1426064-e1ff-42c4-8d61-15422e875768 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:46.944438 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a1426064-e1ff-42c4-8d61-15422e875768 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:46.945203 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a1426064-e1ff-42c4-8d61-15422e875768 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:46.945636 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a1426064-e1ff-42c4-8d61-15422e875768 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:47.073570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a1426064-e1ff-42c4-8d61-15422e875768 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:47.081237 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a1426064-e1ff-42c4-8d61-15422e875768 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.150335 Jun 02 13:58:47.081800 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 262/511] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:46 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:47.513342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b1b68817-1aff-406d-8f77-c88d786c5145 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:47.513956 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b1b68817-1aff-406d-8f77-c88d786c5145 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:47.520465 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b1b68817-1aff-406d-8f77-c88d786c5145 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:47.521062 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b1b68817-1aff-406d-8f77-c88d786c5145 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:47.521827 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b1b68817-1aff-406d-8f77-c88d786c5145 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:47.522263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b1b68817-1aff-406d-8f77-c88d786c5145 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:47.648459 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b1b68817-1aff-406d-8f77-c88d786c5145 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:47.656499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b1b68817-1aff-406d-8f77-c88d786c5145 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:47.658022 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b1b68817-1aff-406d-8f77-c88d786c5145 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:47.659178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b1b68817-1aff-406d-8f77-c88d786c5145 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1721 microversion: 2.20 time: 0.150502 Jun 02 13:58:47.659739 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 250/512] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:47 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:48.098814 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-acc476da-c2f5-431e-b2bf-04cddd5117a1 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:48.099417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-acc476da-c2f5-431e-b2bf-04cddd5117a1 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:48.105971 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-acc476da-c2f5-431e-b2bf-04cddd5117a1 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:48.106413 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-acc476da-c2f5-431e-b2bf-04cddd5117a1 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:48.107160 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-acc476da-c2f5-431e-b2bf-04cddd5117a1 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:48.107592 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-acc476da-c2f5-431e-b2bf-04cddd5117a1 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:48.237441 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-acc476da-c2f5-431e-b2bf-04cddd5117a1 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:48.245186 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-acc476da-c2f5-431e-b2bf-04cddd5117a1 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.150277 Jun 02 13:58:48.245846 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 263/513] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:48 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:48.677441 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-665390c3-f4ca-4a36-96d5-93ecd1e13a21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:48.678053 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-665390c3-f4ca-4a36-96d5-93ecd1e13a21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:48.684568 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-665390c3-f4ca-4a36-96d5-93ecd1e13a21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:48.685014 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-665390c3-f4ca-4a36-96d5-93ecd1e13a21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:48.685764 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-665390c3-f4ca-4a36-96d5-93ecd1e13a21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:48.686195 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-665390c3-f4ca-4a36-96d5-93ecd1e13a21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:48.816139 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-665390c3-f4ca-4a36-96d5-93ecd1e13a21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:48.824689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-665390c3-f4ca-4a36-96d5-93ecd1e13a21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:48.826210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-665390c3-f4ca-4a36-96d5-93ecd1e13a21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:48.827386 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-665390c3-f4ca-4a36-96d5-93ecd1e13a21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1721 microversion: 2.20 time: 0.153856 Jun 02 13:58:48.827932 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 251/514] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:48 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:49.261965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3130e724-7ce4-4c1c-90f2-0aba1dc74716 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:49.262584 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3130e724-7ce4-4c1c-90f2-0aba1dc74716 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:49.268716 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3130e724-7ce4-4c1c-90f2-0aba1dc74716 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:49.274697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3130e724-7ce4-4c1c-90f2-0aba1dc74716 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:49.274697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3130e724-7ce4-4c1c-90f2-0aba1dc74716 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:49.274697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3130e724-7ce4-4c1c-90f2-0aba1dc74716 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:49.397784 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3130e724-7ce4-4c1c-90f2-0aba1dc74716 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:49.406093 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3130e724-7ce4-4c1c-90f2-0aba1dc74716 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.147984 Jun 02 13:58:49.406668 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 264/515] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:49 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:49.484515 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-dea01ae5-c95c-4fbc-bfec-47f3359344cf req-c4bf4b4b-4e61-4e4f-830c-0b6821f7afbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d462ae-af14-4d5d-aab2-f45954429480", "name": "network-vif-unplugged", "status": "completed", "tag": "9494633c-b230-4406-ab57-d1f3d39fc4d6"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:58:49.493485 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-dea01ae5-c95c-4fbc-bfec-47f3359344cf req-c4bf4b4b-4e61-4e4f-830c-0b6821f7afbf service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:49.493980 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-dea01ae5-c95c-4fbc-bfec-47f3359344cf req-c4bf4b4b-4e61-4e4f-830c-0b6821f7afbf service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:49.505010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-dea01ae5-c95c-4fbc-bfec-47f3359344cf req-c4bf4b4b-4e61-4e4f-830c-0b6821f7afbf service nova] Creating event network-vif-unplugged:9494633c-b230-4406-ab57-d1f3d39fc4d6 for instance 83d462ae-af14-4d5d-aab2-f45954429480 on hv-cinder-82651 Jun 02 13:58:49.510594 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-dea01ae5-c95c-4fbc-bfec-47f3359344cf req-c4bf4b4b-4e61-4e4f-830c-0b6821f7afbf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030218 Jun 02 13:58:49.511183 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 252/516] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:58:49.845793 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e1ea5dad-f551-4a52-9df0-d107b51b2f97 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:49.846335 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e1ea5dad-f551-4a52-9df0-d107b51b2f97 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:49.852269 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e1ea5dad-f551-4a52-9df0-d107b51b2f97 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:49.852742 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e1ea5dad-f551-4a52-9df0-d107b51b2f97 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:49.853619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e1ea5dad-f551-4a52-9df0-d107b51b2f97 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:49.854214 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e1ea5dad-f551-4a52-9df0-d107b51b2f97 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:49.985248 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e1ea5dad-f551-4a52-9df0-d107b51b2f97 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:49.992983 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e1ea5dad-f551-4a52-9df0-d107b51b2f97 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:49.995231 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e1ea5dad-f551-4a52-9df0-d107b51b2f97 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:49.996370 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e1ea5dad-f551-4a52-9df0-d107b51b2f97 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1721 microversion: 2.20 time: 0.154631 Jun 02 13:58:49.996959 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 265/517] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:49 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:50.424699 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b7519cea-4a36-4ce9-8791-bee2fa0402ba tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:50.425416 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b7519cea-4a36-4ce9-8791-bee2fa0402ba tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:50.432504 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7519cea-4a36-4ce9-8791-bee2fa0402ba tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:50.432954 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7519cea-4a36-4ce9-8791-bee2fa0402ba tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:50.434404 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7519cea-4a36-4ce9-8791-bee2fa0402ba tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:50.434839 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b7519cea-4a36-4ce9-8791-bee2fa0402ba tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:50.565811 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b7519cea-4a36-4ce9-8791-bee2fa0402ba tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:50.573370 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b7519cea-4a36-4ce9-8791-bee2fa0402ba tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.154036 Jun 02 13:58:50.576623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 253/518] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:50 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:51.016425 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-475e4603-159e-4230-8816-67be18a1c80c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:51.017043 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-475e4603-159e-4230-8816-67be18a1c80c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:51.022990 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-475e4603-159e-4230-8816-67be18a1c80c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:51.023843 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-475e4603-159e-4230-8816-67be18a1c80c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:51.024627 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-475e4603-159e-4230-8816-67be18a1c80c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:51.025705 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-475e4603-159e-4230-8816-67be18a1c80c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:51.158648 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-475e4603-159e-4230-8816-67be18a1c80c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:51.167036 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-475e4603-159e-4230-8816-67be18a1c80c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:51.168589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-475e4603-159e-4230-8816-67be18a1c80c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:51.169740 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-475e4603-159e-4230-8816-67be18a1c80c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1721 microversion: 2.20 time: 0.157232 Jun 02 13:58:51.170296 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 266/519] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:51 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:51.593653 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f9248861-c1f5-4604-ad73-e57770e7424a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:51.611474 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f9248861-c1f5-4604-ad73-e57770e7424a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:51.611474 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f9248861-c1f5-4604-ad73-e57770e7424a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:51.611474 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f9248861-c1f5-4604-ad73-e57770e7424a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:51.611474 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f9248861-c1f5-4604-ad73-e57770e7424a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:51.611948 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f9248861-c1f5-4604-ad73-e57770e7424a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:51.734826 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f9248861-c1f5-4604-ad73-e57770e7424a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:51.742496 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f9248861-c1f5-4604-ad73-e57770e7424a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.152731 Jun 02 13:58:51.743376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 254/520] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:51 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:52.188256 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-44eb91b3-7c4a-412a-a9ae-37c8a2a0804e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:52.188886 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-44eb91b3-7c4a-412a-a9ae-37c8a2a0804e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:52.194816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44eb91b3-7c4a-412a-a9ae-37c8a2a0804e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:52.195256 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44eb91b3-7c4a-412a-a9ae-37c8a2a0804e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:52.195991 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44eb91b3-7c4a-412a-a9ae-37c8a2a0804e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:52.196488 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44eb91b3-7c4a-412a-a9ae-37c8a2a0804e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:52.325904 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-44eb91b3-7c4a-412a-a9ae-37c8a2a0804e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:52.333743 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-44eb91b3-7c4a-412a-a9ae-37c8a2a0804e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:52.335250 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-44eb91b3-7c4a-412a-a9ae-37c8a2a0804e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:52.336420 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-44eb91b3-7c4a-412a-a9ae-37c8a2a0804e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1721 microversion: 2.20 time: 0.152007 Jun 02 13:58:52.336980 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 267/521] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:52 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:52.759200 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-6aa18323-b2cd-4cf3-a687-795f067da77a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:52.759764 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-6aa18323-b2cd-4cf3-a687-795f067da77a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:52.766757 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6aa18323-b2cd-4cf3-a687-795f067da77a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:52.767195 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6aa18323-b2cd-4cf3-a687-795f067da77a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:52.767939 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6aa18323-b2cd-4cf3-a687-795f067da77a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:52.768361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6aa18323-b2cd-4cf3-a687-795f067da77a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:52.893906 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6aa18323-b2cd-4cf3-a687-795f067da77a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:52.901847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-6aa18323-b2cd-4cf3-a687-795f067da77a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.146281 Jun 02 13:58:52.902413 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 255/522] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:52 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:53.355190 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-da7c0f8a-9386-4877-9cf7-5520bc31bf63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:53.355732 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-da7c0f8a-9386-4877-9cf7-5520bc31bf63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:53.361677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-da7c0f8a-9386-4877-9cf7-5520bc31bf63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:53.362126 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-da7c0f8a-9386-4877-9cf7-5520bc31bf63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:53.362908 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-da7c0f8a-9386-4877-9cf7-5520bc31bf63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:53.363339 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-da7c0f8a-9386-4877-9cf7-5520bc31bf63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:53.492164 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-da7c0f8a-9386-4877-9cf7-5520bc31bf63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:53.502744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-da7c0f8a-9386-4877-9cf7-5520bc31bf63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:53.503636 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-da7c0f8a-9386-4877-9cf7-5520bc31bf63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:53.504803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-da7c0f8a-9386-4877-9cf7-5520bc31bf63 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1724 microversion: 2.20 time: 0.154170 Jun 02 13:58:53.505453 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 268/523] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:53 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:53.522242 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-66dac1d9-fc84-438f-bd27-b5ff00bfe2f5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c062707-50cc-4a34-a390-48f5b8a18621"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:58:53.523292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-66dac1d9-fc84-438f-bd27-b5ff00bfe2f5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:53.529388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-66dac1d9-fc84-438f-bd27-b5ff00bfe2f5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:53.529833 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-66dac1d9-fc84-438f-bd27-b5ff00bfe2f5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:53.530582 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-66dac1d9-fc84-438f-bd27-b5ff00bfe2f5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:53.531012 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-66dac1d9-fc84-438f-bd27-b5ff00bfe2f5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:53.919113 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-398c46aa-161b-44c9-a2b6-86d3f57d5842 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:53.919730 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-398c46aa-161b-44c9-a2b6-86d3f57d5842 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:53.925810 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-398c46aa-161b-44c9-a2b6-86d3f57d5842 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:53.926256 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-398c46aa-161b-44c9-a2b6-86d3f57d5842 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:53.927010 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-398c46aa-161b-44c9-a2b6-86d3f57d5842 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:53.927441 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-398c46aa-161b-44c9-a2b6-86d3f57d5842 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:54.061731 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-398c46aa-161b-44c9-a2b6-86d3f57d5842 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:54.069405 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-398c46aa-161b-44c9-a2b6-86d3f57d5842 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.154909 Jun 02 13:58:54.073684 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 269/524] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:53 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:58:54.289940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-d4d4d199-a1f2-4767-8c40-965b51f6ea07 req-81dd9758-be3b-4ace-b855-1736ebbc01dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "783eae57-62e0-4101-ae12-14b73c9f87db", "name": "network-vif-plugged", "status": "completed", "tag": "206884cb-c7bb-4476-9320-75dc2245d246"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:58:54.298282 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-d4d4d199-a1f2-4767-8c40-965b51f6ea07 req-81dd9758-be3b-4ace-b855-1736ebbc01dd service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:54.298753 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-d4d4d199-a1f2-4767-8c40-965b51f6ea07 req-81dd9758-be3b-4ace-b855-1736ebbc01dd service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:54.309660 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-d4d4d199-a1f2-4767-8c40-965b51f6ea07 req-81dd9758-be3b-4ace-b855-1736ebbc01dd service nova] Creating event network-vif-plugged:206884cb-c7bb-4476-9320-75dc2245d246 for instance 783eae57-62e0-4101-ae12-14b73c9f87db on hv-cinder-82651 Jun 02 13:58:54.315053 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-d4d4d199-a1f2-4767-8c40-965b51f6ea07 req-81dd9758-be3b-4ace-b855-1736ebbc01dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028741 Jun 02 13:58:54.315799 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 270/525] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:58:54.613908 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-66dac1d9-fc84-438f-bd27-b5ff00bfe2f5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "POST /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.095551 Jun 02 13:58:54.614873 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 256/526] 10.222.0.33 () {62 vars in 1363 bytes} [Thu Jun 2 13:58:53 2022] POST /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments => generated 188 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:58:54.745040 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7040d836-8e5c-4990-ba58-31d0c214c927 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:58:54.745040 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7040d836-8e5c-4990-ba58-31d0c214c927 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:54.751809 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7040d836-8e5c-4990-ba58-31d0c214c927 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:54.752253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7040d836-8e5c-4990-ba58-31d0c214c927 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:54.753030 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7040d836-8e5c-4990-ba58-31d0c214c927 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:54.753457 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7040d836-8e5c-4990-ba58-31d0c214c927 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:55.009827 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7040d836-8e5c-4990-ba58-31d0c214c927 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "POST /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/action" status: 202 len: 0 microversion: 2.20 time: 0.270315 Jun 02 13:58:55.010703 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 271/527] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 2 13:58:54 2022] POST /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:58:55.018961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0b1ede5c-1afb-43ce-94cc-e4da0badefa8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:55.019613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0b1ede5c-1afb-43ce-94cc-e4da0badefa8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:55.026850 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0b1ede5c-1afb-43ce-94cc-e4da0badefa8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:55.027304 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0b1ede5c-1afb-43ce-94cc-e4da0badefa8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:55.028248 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0b1ede5c-1afb-43ce-94cc-e4da0badefa8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:55.028760 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0b1ede5c-1afb-43ce-94cc-e4da0badefa8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:55.086878 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ba888164-48dc-4a8a-b440-31ceafaaf640 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:55.087515 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ba888164-48dc-4a8a-b440-31ceafaaf640 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:55.093639 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ba888164-48dc-4a8a-b440-31ceafaaf640 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:55.094161 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ba888164-48dc-4a8a-b440-31ceafaaf640 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:55.094993 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ba888164-48dc-4a8a-b440-31ceafaaf640 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:55.095518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ba888164-48dc-4a8a-b440-31ceafaaf640 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:55.165102 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0b1ede5c-1afb-43ce-94cc-e4da0badefa8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:55.174239 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0b1ede5c-1afb-43ce-94cc-e4da0badefa8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:55.175979 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0b1ede5c-1afb-43ce-94cc-e4da0badefa8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:55.177162 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0b1ede5c-1afb-43ce-94cc-e4da0badefa8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1750 microversion: 2.20 time: 0.162153 Jun 02 13:58:55.177884 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 257/528] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:55 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:55.362459 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ba888164-48dc-4a8a-b440-31ceafaaf640 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:55.370213 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ba888164-48dc-4a8a-b440-31ceafaaf640 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.287305 Jun 02 13:58:55.370884 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 272/529] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:55 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:58:56.196482 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4ddda691-372b-483c-8a22-cfd98a688863 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:56.197110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4ddda691-372b-483c-8a22-cfd98a688863 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:56.204117 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4ddda691-372b-483c-8a22-cfd98a688863 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:56.205855 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4ddda691-372b-483c-8a22-cfd98a688863 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:56.205855 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4ddda691-372b-483c-8a22-cfd98a688863 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:56.205855 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4ddda691-372b-483c-8a22-cfd98a688863 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:56.336533 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4ddda691-372b-483c-8a22-cfd98a688863 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:56.345512 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4ddda691-372b-483c-8a22-cfd98a688863 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:56.347019 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4ddda691-372b-483c-8a22-cfd98a688863 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:56.348177 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4ddda691-372b-483c-8a22-cfd98a688863 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1750 microversion: 2.20 time: 0.155675 Jun 02 13:58:56.348774 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 258/530] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:56 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:56.396723 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-61658073-5ff2-4c0e-8579-12cefb597211 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:56.397362 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-61658073-5ff2-4c0e-8579-12cefb597211 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:56.404222 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-61658073-5ff2-4c0e-8579-12cefb597211 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:56.404774 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-61658073-5ff2-4c0e-8579-12cefb597211 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:56.405530 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-61658073-5ff2-4c0e-8579-12cefb597211 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:56.405964 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-61658073-5ff2-4c0e-8579-12cefb597211 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:56.535543 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-61658073-5ff2-4c0e-8579-12cefb597211 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:56.543117 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-61658073-5ff2-4c0e-8579-12cefb597211 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1359 microversion: 2.1 time: 0.150259 Jun 02 13:58:56.543676 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 273/531] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:56 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:57.366828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-24c1b9b2-9ed9-4692-adb0-f50660c1e3f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:57.367439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-24c1b9b2-9ed9-4692-adb0-f50660c1e3f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:57.373990 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-24c1b9b2-9ed9-4692-adb0-f50660c1e3f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:57.374439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-24c1b9b2-9ed9-4692-adb0-f50660c1e3f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:57.375199 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-24c1b9b2-9ed9-4692-adb0-f50660c1e3f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:57.375634 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-24c1b9b2-9ed9-4692-adb0-f50660c1e3f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:57.511588 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-24c1b9b2-9ed9-4692-adb0-f50660c1e3f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:57.520343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-24c1b9b2-9ed9-4692-adb0-f50660c1e3f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:57.521902 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-24c1b9b2-9ed9-4692-adb0-f50660c1e3f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:57.523136 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-24c1b9b2-9ed9-4692-adb0-f50660c1e3f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1752 microversion: 2.20 time: 0.160275 Jun 02 13:58:57.523701 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 259/532] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:57 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:57.559195 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e15037ed-bc9d-4fe2-8cfa-ef86dfa717bc tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:57.559804 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e15037ed-bc9d-4fe2-8cfa-ef86dfa717bc tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:57.565889 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e15037ed-bc9d-4fe2-8cfa-ef86dfa717bc tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:57.566334 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e15037ed-bc9d-4fe2-8cfa-ef86dfa717bc tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:57.567086 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e15037ed-bc9d-4fe2-8cfa-ef86dfa717bc tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:57.567515 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e15037ed-bc9d-4fe2-8cfa-ef86dfa717bc tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:57.691544 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e15037ed-bc9d-4fe2-8cfa-ef86dfa717bc tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:57.698953 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e15037ed-bc9d-4fe2-8cfa-ef86dfa717bc tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1548 microversion: 2.1 time: 0.143818 Jun 02 13:58:57.700040 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 274/533] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:57 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1548 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:57.716460 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b4f05c5e-c681-4eb9-a639-e952ae66e0f7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:57.717022 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b4f05c5e-c681-4eb9-a639-e952ae66e0f7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:57.723155 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b4f05c5e-c681-4eb9-a639-e952ae66e0f7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:57.723603 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b4f05c5e-c681-4eb9-a639-e952ae66e0f7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:57.724362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b4f05c5e-c681-4eb9-a639-e952ae66e0f7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:57.724824 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b4f05c5e-c681-4eb9-a639-e952ae66e0f7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:57.854049 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b4f05c5e-c681-4eb9-a639-e952ae66e0f7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:57.862143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b4f05c5e-c681-4eb9-a639-e952ae66e0f7 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1548 microversion: 2.1 time: 0.150179 Jun 02 13:58:57.862761 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 260/534] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:57 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:57.878331 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d2ccd5a4-f2ff-4e9e-bc1d-6ead48e5529f tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:57.881926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d2ccd5a4-f2ff-4e9e-bc1d-6ead48e5529f tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:57.882684 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d2ccd5a4-f2ff-4e9e-bc1d-6ead48e5529f tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Searching by: {'deleted': False, 'project_id': '93c4473545ff46bbaa857263e85af2f1'} {{(pid=118316) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 02 13:58:57.890131 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d2ccd5a4-f2ff-4e9e-bc1d-6ead48e5529f tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:57.890569 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d2ccd5a4-f2ff-4e9e-bc1d-6ead48e5529f tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:57.891354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d2ccd5a4-f2ff-4e9e-bc1d-6ead48e5529f tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:57.891834 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d2ccd5a4-f2ff-4e9e-bc1d-6ead48e5529f tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:57.983896 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.multi_cell_list [None req-d2ccd5a4-f2ff-4e9e-bc1d-6ead48e5529f tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118316) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 02 13:58:58.068217 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:58.085906 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d2ccd5a4-f2ff-4e9e-bc1d-6ead48e5529f tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.211235 Jun 02 13:58:58.086498 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 275/535] 10.222.0.33 () {58 vars in 1124 bytes} [Thu Jun 2 13:58:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:58:58.096589 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-42b05703-fd53-47c5-8c7f-78a3347add6c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:58.097396 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-42b05703-fd53-47c5-8c7f-78a3347add6c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:58.104457 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-42b05703-fd53-47c5-8c7f-78a3347add6c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:58.104989 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-42b05703-fd53-47c5-8c7f-78a3347add6c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:58.106071 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-42b05703-fd53-47c5-8c7f-78a3347add6c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:58.106578 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-42b05703-fd53-47c5-8c7f-78a3347add6c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:58.290130 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-42b05703-fd53-47c5-8c7f-78a3347add6c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:58.298176 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-42b05703-fd53-47c5-8c7f-78a3347add6c tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1548 microversion: 2.1 time: 0.205408 Jun 02 13:58:58.300548 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 261/536] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:58:58 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1548 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:58:58.542699 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-781b8e19-3953-4b86-968e-97e8c6499346 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:58.543833 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-781b8e19-3953-4b86-968e-97e8c6499346 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:58.550582 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-781b8e19-3953-4b86-968e-97e8c6499346 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:58.551029 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-781b8e19-3953-4b86-968e-97e8c6499346 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:58.551784 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-781b8e19-3953-4b86-968e-97e8c6499346 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:58.552215 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-781b8e19-3953-4b86-968e-97e8c6499346 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:58.698935 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-781b8e19-3953-4b86-968e-97e8c6499346 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:58.708698 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-781b8e19-3953-4b86-968e-97e8c6499346 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:58.710195 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-781b8e19-3953-4b86-968e-97e8c6499346 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:58.711367 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-781b8e19-3953-4b86-968e-97e8c6499346 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1752 microversion: 2.20 time: 0.172714 Jun 02 13:58:58.711922 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 276/537] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:58 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:58:59.735534 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-75bf99b3-a40c-435e-abaa-0902f9508ce1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:58:59.736141 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-75bf99b3-a40c-435e-abaa-0902f9508ce1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:58:59.742374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-75bf99b3-a40c-435e-abaa-0902f9508ce1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:59.742826 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-75bf99b3-a40c-435e-abaa-0902f9508ce1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:59.743580 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-75bf99b3-a40c-435e-abaa-0902f9508ce1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:58:59.744011 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-75bf99b3-a40c-435e-abaa-0902f9508ce1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:58:59.763778 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:59.880787 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-75bf99b3-a40c-435e-abaa-0902f9508ce1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:59.890143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-75bf99b3-a40c-435e-abaa-0902f9508ce1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:59.891809 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-75bf99b3-a40c-435e-abaa-0902f9508ce1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:58:59.893129 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-75bf99b3-a40c-435e-abaa-0902f9508ce1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.162432 Jun 02 13:58:59.893813 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 262/538] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:58:59 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:59:00.911729 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-28890ab1-9b06-45c2-b448-6792d8312a88 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:00.912365 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-28890ab1-9b06-45c2-b448-6792d8312a88 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:00.918738 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-28890ab1-9b06-45c2-b448-6792d8312a88 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:00.919186 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-28890ab1-9b06-45c2-b448-6792d8312a88 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:00.919969 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-28890ab1-9b06-45c2-b448-6792d8312a88 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:00.920462 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-28890ab1-9b06-45c2-b448-6792d8312a88 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:01.101986 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-28890ab1-9b06-45c2-b448-6792d8312a88 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:01.116188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-28890ab1-9b06-45c2-b448-6792d8312a88 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:01.117895 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-28890ab1-9b06-45c2-b448-6792d8312a88 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:01.122101 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-28890ab1-9b06-45c2-b448-6792d8312a88 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.213410 Jun 02 13:59:01.127218 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 277/539] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:00 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:59:01.330390 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1afd0ed2-7a55-44a2-9a39-8c4392f9b4e5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "049400a3-fe28-4366-9672-1276585d0905"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:59:01.331510 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1afd0ed2-7a55-44a2-9a39-8c4392f9b4e5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:01.338196 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1afd0ed2-7a55-44a2-9a39-8c4392f9b4e5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:01.338748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1afd0ed2-7a55-44a2-9a39-8c4392f9b4e5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:01.339605 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1afd0ed2-7a55-44a2-9a39-8c4392f9b4e5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:01.340331 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1afd0ed2-7a55-44a2-9a39-8c4392f9b4e5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:02.255790 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-11b6eb4b-a473-4e2e-b112-c66ac59d9f02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:02.256421 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-11b6eb4b-a473-4e2e-b112-c66ac59d9f02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:02.262497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-11b6eb4b-a473-4e2e-b112-c66ac59d9f02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:02.262939 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-11b6eb4b-a473-4e2e-b112-c66ac59d9f02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:02.263693 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-11b6eb4b-a473-4e2e-b112-c66ac59d9f02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:02.264123 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-11b6eb4b-a473-4e2e-b112-c66ac59d9f02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:02.413831 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-11b6eb4b-a473-4e2e-b112-c66ac59d9f02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:02.423038 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-11b6eb4b-a473-4e2e-b112-c66ac59d9f02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:02.424589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-11b6eb4b-a473-4e2e-b112-c66ac59d9f02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:02.425757 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-11b6eb4b-a473-4e2e-b112-c66ac59d9f02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.283471 Jun 02 13:59:02.426319 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 278/540] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:02 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:03.011814 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:59:03.012064 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Thu Jun 2 13:59:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:59:03.445500 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a9cb2c0e-36e9-409f-8d2c-7ba094202619 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:03.446150 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a9cb2c0e-36e9-409f-8d2c-7ba094202619 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:03.452430 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a9cb2c0e-36e9-409f-8d2c-7ba094202619 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:03.452910 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a9cb2c0e-36e9-409f-8d2c-7ba094202619 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:03.453662 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a9cb2c0e-36e9-409f-8d2c-7ba094202619 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:03.454089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a9cb2c0e-36e9-409f-8d2c-7ba094202619 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:03.594503 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a9cb2c0e-36e9-409f-8d2c-7ba094202619 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:03.603139 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a9cb2c0e-36e9-409f-8d2c-7ba094202619 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:03.604752 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a9cb2c0e-36e9-409f-8d2c-7ba094202619 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:03.606572 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a9cb2c0e-36e9-409f-8d2c-7ba094202619 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.164899 Jun 02 13:59:03.607193 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 279/541] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:03 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:04.624828 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f07c58c9-5416-4daf-96ba-f57ad79d049d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:04.625518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f07c58c9-5416-4daf-96ba-f57ad79d049d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:04.631649 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f07c58c9-5416-4daf-96ba-f57ad79d049d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:04.632095 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f07c58c9-5416-4daf-96ba-f57ad79d049d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:04.632891 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f07c58c9-5416-4daf-96ba-f57ad79d049d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:04.633323 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f07c58c9-5416-4daf-96ba-f57ad79d049d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:04.774015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f07c58c9-5416-4daf-96ba-f57ad79d049d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:04.783024 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f07c58c9-5416-4daf-96ba-f57ad79d049d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:04.784550 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f07c58c9-5416-4daf-96ba-f57ad79d049d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:04.785727 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f07c58c9-5416-4daf-96ba-f57ad79d049d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.164873 Jun 02 13:59:04.786564 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 280/542] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:04 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:05.803882 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-93e41aff-4063-4a7d-8686-0b96f54c86b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:05.805541 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-93e41aff-4063-4a7d-8686-0b96f54c86b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:05.813130 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-93e41aff-4063-4a7d-8686-0b96f54c86b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:05.814246 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-93e41aff-4063-4a7d-8686-0b96f54c86b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:05.815252 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-93e41aff-4063-4a7d-8686-0b96f54c86b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:05.815921 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-93e41aff-4063-4a7d-8686-0b96f54c86b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:05.958926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-93e41aff-4063-4a7d-8686-0b96f54c86b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:05.968126 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-93e41aff-4063-4a7d-8686-0b96f54c86b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:05.969677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-93e41aff-4063-4a7d-8686-0b96f54c86b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:05.970850 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-93e41aff-4063-4a7d-8686-0b96f54c86b8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.171443 Jun 02 13:59:05.971554 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 281/543] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:05 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:06.990113 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5dacce7b-81f9-41e1-8a28-c38073553f79 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:06.990821 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-5dacce7b-81f9-41e1-8a28-c38073553f79 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:06.992694 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=60 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:06.997618 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5dacce7b-81f9-41e1-8a28-c38073553f79 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:06.998064 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5dacce7b-81f9-41e1-8a28-c38073553f79 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:06.998883 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5dacce7b-81f9-41e1-8a28-c38073553f79 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:06.999355 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5dacce7b-81f9-41e1-8a28-c38073553f79 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:07.130036 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5dacce7b-81f9-41e1-8a28-c38073553f79 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:07.138536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5dacce7b-81f9-41e1-8a28-c38073553f79 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:07.140067 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5dacce7b-81f9-41e1-8a28-c38073553f79 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:07.141241 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5dacce7b-81f9-41e1-8a28-c38073553f79 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.155070 Jun 02 13:59:07.141824 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 282/544] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:06 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:08.159552 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-368cfa3d-bccf-481b-89f9-628717d4f4b9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:08.160368 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-368cfa3d-bccf-481b-89f9-628717d4f4b9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:08.162274 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:08.167201 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-368cfa3d-bccf-481b-89f9-628717d4f4b9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:08.167718 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-368cfa3d-bccf-481b-89f9-628717d4f4b9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:08.169165 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-368cfa3d-bccf-481b-89f9-628717d4f4b9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:08.169654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-368cfa3d-bccf-481b-89f9-628717d4f4b9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:08.313052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-368cfa3d-bccf-481b-89f9-628717d4f4b9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:08.322114 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-368cfa3d-bccf-481b-89f9-628717d4f4b9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:08.323714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-368cfa3d-bccf-481b-89f9-628717d4f4b9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:08.325447 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-368cfa3d-bccf-481b-89f9-628717d4f4b9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.169773 Jun 02 13:59:08.326082 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 283/545] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:08 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:09.343251 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a187d027-fbd7-4a31-a533-5d7f7b1f2367 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:09.343971 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a187d027-fbd7-4a31-a533-5d7f7b1f2367 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:09.349991 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a187d027-fbd7-4a31-a533-5d7f7b1f2367 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:09.350434 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a187d027-fbd7-4a31-a533-5d7f7b1f2367 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:09.351183 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a187d027-fbd7-4a31-a533-5d7f7b1f2367 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:09.351613 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a187d027-fbd7-4a31-a533-5d7f7b1f2367 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:09.487564 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a187d027-fbd7-4a31-a533-5d7f7b1f2367 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:09.496579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a187d027-fbd7-4a31-a533-5d7f7b1f2367 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:09.498875 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a187d027-fbd7-4a31-a533-5d7f7b1f2367 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:09.500131 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a187d027-fbd7-4a31-a533-5d7f7b1f2367 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.160855 Jun 02 13:59:09.501013 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 284/546] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:09 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:10.522289 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-59c112a1-44e1-451a-b0f8-92f31aa1aa02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:10.523100 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-59c112a1-44e1-451a-b0f8-92f31aa1aa02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:10.530716 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-59c112a1-44e1-451a-b0f8-92f31aa1aa02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:10.531164 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-59c112a1-44e1-451a-b0f8-92f31aa1aa02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:10.531971 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-59c112a1-44e1-451a-b0f8-92f31aa1aa02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:10.532417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-59c112a1-44e1-451a-b0f8-92f31aa1aa02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:10.667863 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-59c112a1-44e1-451a-b0f8-92f31aa1aa02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:10.678998 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-59c112a1-44e1-451a-b0f8-92f31aa1aa02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:10.679766 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-59c112a1-44e1-451a-b0f8-92f31aa1aa02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:10.681000 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-59c112a1-44e1-451a-b0f8-92f31aa1aa02 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.166348 Jun 02 13:59:10.681555 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 285/547] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:10 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:11.335507 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=45 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:11.424750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=8 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:11.701670 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e00c22ee-e005-4822-8cc4-f2a372890b26 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:11.702335 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e00c22ee-e005-4822-8cc4-f2a372890b26 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:11.709231 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e00c22ee-e005-4822-8cc4-f2a372890b26 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:11.709680 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e00c22ee-e005-4822-8cc4-f2a372890b26 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:11.710440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e00c22ee-e005-4822-8cc4-f2a372890b26 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:11.710871 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e00c22ee-e005-4822-8cc4-f2a372890b26 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:11.858894 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e00c22ee-e005-4822-8cc4-f2a372890b26 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:11.867748 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e00c22ee-e005-4822-8cc4-f2a372890b26 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:11.869295 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e00c22ee-e005-4822-8cc4-f2a372890b26 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:11.870461 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e00c22ee-e005-4822-8cc4-f2a372890b26 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.174714 Jun 02 13:59:11.871223 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 286/548] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:11 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:12.889178 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-794def17-404e-4fc9-b2cd-d28ca8ec8486 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:12.890020 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-794def17-404e-4fc9-b2cd-d28ca8ec8486 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:12.895608 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-794def17-404e-4fc9-b2cd-d28ca8ec8486 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:12.896044 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-794def17-404e-4fc9-b2cd-d28ca8ec8486 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:12.896814 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-794def17-404e-4fc9-b2cd-d28ca8ec8486 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:12.897241 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-794def17-404e-4fc9-b2cd-d28ca8ec8486 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:13.029035 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-794def17-404e-4fc9-b2cd-d28ca8ec8486 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:13.038095 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-794def17-404e-4fc9-b2cd-d28ca8ec8486 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:13.039637 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-794def17-404e-4fc9-b2cd-d28ca8ec8486 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:13.040825 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-794def17-404e-4fc9-b2cd-d28ca8ec8486 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.156289 Jun 02 13:59:13.041466 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 287/549] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:12 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:14.059400 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d046470f-0aff-47aa-91b7-314b96a789b3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:14.060108 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d046470f-0aff-47aa-91b7-314b96a789b3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:14.066046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d046470f-0aff-47aa-91b7-314b96a789b3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:14.066493 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d046470f-0aff-47aa-91b7-314b96a789b3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:14.067254 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d046470f-0aff-47aa-91b7-314b96a789b3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:14.067687 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d046470f-0aff-47aa-91b7-314b96a789b3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:14.205186 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d046470f-0aff-47aa-91b7-314b96a789b3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:14.213757 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d046470f-0aff-47aa-91b7-314b96a789b3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:14.215270 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d046470f-0aff-47aa-91b7-314b96a789b3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:14.216871 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d046470f-0aff-47aa-91b7-314b96a789b3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.161269 Jun 02 13:59:14.217534 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 288/550] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:14 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:15.235383 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4d02e2ba-92bf-466e-b587-0f8ff8430c4a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:15.236039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4d02e2ba-92bf-466e-b587-0f8ff8430c4a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:15.242255 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4d02e2ba-92bf-466e-b587-0f8ff8430c4a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:15.242752 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4d02e2ba-92bf-466e-b587-0f8ff8430c4a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:15.243501 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4d02e2ba-92bf-466e-b587-0f8ff8430c4a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:15.243923 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4d02e2ba-92bf-466e-b587-0f8ff8430c4a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:15.369248 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4d02e2ba-92bf-466e-b587-0f8ff8430c4a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:15.377706 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4d02e2ba-92bf-466e-b587-0f8ff8430c4a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:15.379212 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4d02e2ba-92bf-466e-b587-0f8ff8430c4a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:15.380362 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4d02e2ba-92bf-466e-b587-0f8ff8430c4a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.149066 Jun 02 13:59:15.380958 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 289/551] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:15 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:16.398072 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-aa2c8913-26fc-473e-8263-e630cb2d4ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:16.398765 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-aa2c8913-26fc-473e-8263-e630cb2d4ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:16.405224 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aa2c8913-26fc-473e-8263-e630cb2d4ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:16.405666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aa2c8913-26fc-473e-8263-e630cb2d4ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:16.406411 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aa2c8913-26fc-473e-8263-e630cb2d4ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:16.406838 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aa2c8913-26fc-473e-8263-e630cb2d4ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:16.537161 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-aa2c8913-26fc-473e-8263-e630cb2d4ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:16.546676 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-aa2c8913-26fc-473e-8263-e630cb2d4ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:16.548174 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-aa2c8913-26fc-473e-8263-e630cb2d4ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:16.549354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-aa2c8913-26fc-473e-8263-e630cb2d4ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.155200 Jun 02 13:59:16.549901 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 290/552] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:16 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:17.567241 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-263dae2f-feed-4028-8c6c-635c4de06d7b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:17.567903 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-263dae2f-feed-4028-8c6c-635c4de06d7b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:17.574331 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-263dae2f-feed-4028-8c6c-635c4de06d7b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:17.574785 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-263dae2f-feed-4028-8c6c-635c4de06d7b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:17.576210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-263dae2f-feed-4028-8c6c-635c4de06d7b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:17.576651 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-263dae2f-feed-4028-8c6c-635c4de06d7b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:17.704739 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-263dae2f-feed-4028-8c6c-635c4de06d7b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:17.713456 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-263dae2f-feed-4028-8c6c-635c4de06d7b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:17.716920 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-263dae2f-feed-4028-8c6c-635c4de06d7b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:17.716920 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-263dae2f-feed-4028-8c6c-635c4de06d7b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.152848 Jun 02 13:59:17.717413 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 291/553] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:17 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:18.735697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-15d6d822-9eb1-47e9-acc7-aaf0813a6816 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:18.736330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-15d6d822-9eb1-47e9-acc7-aaf0813a6816 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:18.742480 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-15d6d822-9eb1-47e9-acc7-aaf0813a6816 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:18.742923 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-15d6d822-9eb1-47e9-acc7-aaf0813a6816 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:18.743674 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-15d6d822-9eb1-47e9-acc7-aaf0813a6816 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:18.744121 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-15d6d822-9eb1-47e9-acc7-aaf0813a6816 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:18.762580 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:18.879615 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-15d6d822-9eb1-47e9-acc7-aaf0813a6816 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:18.888483 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-15d6d822-9eb1-47e9-acc7-aaf0813a6816 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:18.890683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-15d6d822-9eb1-47e9-acc7-aaf0813a6816 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:18.891839 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-15d6d822-9eb1-47e9-acc7-aaf0813a6816 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.160933 Jun 02 13:59:18.892686 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 292/554] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:18 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:19.911166 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3398c4d5-5ea8-4a34-9a40-47409482d5c2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:19.911782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3398c4d5-5ea8-4a34-9a40-47409482d5c2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:19.918434 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3398c4d5-5ea8-4a34-9a40-47409482d5c2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:19.918939 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3398c4d5-5ea8-4a34-9a40-47409482d5c2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:19.919698 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3398c4d5-5ea8-4a34-9a40-47409482d5c2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:19.920173 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3398c4d5-5ea8-4a34-9a40-47409482d5c2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:20.050510 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3398c4d5-5ea8-4a34-9a40-47409482d5c2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:20.058968 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3398c4d5-5ea8-4a34-9a40-47409482d5c2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:20.060558 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3398c4d5-5ea8-4a34-9a40-47409482d5c2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:20.062217 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3398c4d5-5ea8-4a34-9a40-47409482d5c2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.154992 Jun 02 13:59:20.062771 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 293/555] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:19 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:20.395065 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1afd0ed2-7a55-44a2-9a39-8c4392f9b4e5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "POST /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 19.070270 Jun 02 13:59:20.395684 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 263/556] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 2 13:59:01 2022] POST /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments => generated 194 bytes in 19072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:59:21.080226 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ad335814-60ac-4c3e-bf34-659d33f56384 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:21.080976 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ad335814-60ac-4c3e-bf34-659d33f56384 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:21.087026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ad335814-60ac-4c3e-bf34-659d33f56384 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:21.087468 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ad335814-60ac-4c3e-bf34-659d33f56384 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:21.088207 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ad335814-60ac-4c3e-bf34-659d33f56384 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:21.088658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ad335814-60ac-4c3e-bf34-659d33f56384 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:21.216392 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ad335814-60ac-4c3e-bf34-659d33f56384 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:21.225543 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ad335814-60ac-4c3e-bf34-659d33f56384 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:21.227052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ad335814-60ac-4c3e-bf34-659d33f56384 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:21.228202 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ad335814-60ac-4c3e-bf34-659d33f56384 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.151851 Jun 02 13:59:21.228823 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 294/557] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:21 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:59:22.247659 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-97110e76-4a51-4f04-9e0f-681f1ea94bb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:22.249249 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-97110e76-4a51-4f04-9e0f-681f1ea94bb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:22.256665 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-97110e76-4a51-4f04-9e0f-681f1ea94bb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:22.257111 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-97110e76-4a51-4f04-9e0f-681f1ea94bb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:22.257872 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-97110e76-4a51-4f04-9e0f-681f1ea94bb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:22.258300 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-97110e76-4a51-4f04-9e0f-681f1ea94bb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:22.587751 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-97110e76-4a51-4f04-9e0f-681f1ea94bb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:22.596916 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-97110e76-4a51-4f04-9e0f-681f1ea94bb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:22.598419 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-97110e76-4a51-4f04-9e0f-681f1ea94bb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:22.599563 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-97110e76-4a51-4f04-9e0f-681f1ea94bb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.356793 Jun 02 13:59:22.600116 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 264/558] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:22 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:59:23.618138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b1bb222d-48de-44e2-863b-250b61a21ef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:23.618752 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b1bb222d-48de-44e2-863b-250b61a21ef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:23.625647 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b1bb222d-48de-44e2-863b-250b61a21ef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:23.626090 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b1bb222d-48de-44e2-863b-250b61a21ef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:23.626843 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b1bb222d-48de-44e2-863b-250b61a21ef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:23.627272 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b1bb222d-48de-44e2-863b-250b61a21ef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:23.752871 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b1bb222d-48de-44e2-863b-250b61a21ef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:23.761118 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b1bb222d-48de-44e2-863b-250b61a21ef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:23.762627 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b1bb222d-48de-44e2-863b-250b61a21ef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:23.764273 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b1bb222d-48de-44e2-863b-250b61a21ef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.149490 Jun 02 13:59:23.764982 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 295/559] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:23 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:59:24.783664 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4e42b2c2-8f2a-4ac7-b512-a8a8d004d464 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:24.784214 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4e42b2c2-8f2a-4ac7-b512-a8a8d004d464 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:24.790752 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4e42b2c2-8f2a-4ac7-b512-a8a8d004d464 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:24.791201 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4e42b2c2-8f2a-4ac7-b512-a8a8d004d464 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:24.792001 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4e42b2c2-8f2a-4ac7-b512-a8a8d004d464 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:24.792463 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4e42b2c2-8f2a-4ac7-b512-a8a8d004d464 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:24.922849 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4e42b2c2-8f2a-4ac7-b512-a8a8d004d464 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:24.931337 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4e42b2c2-8f2a-4ac7-b512-a8a8d004d464 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:24.932890 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4e42b2c2-8f2a-4ac7-b512-a8a8d004d464 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:24.934044 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4e42b2c2-8f2a-4ac7-b512-a8a8d004d464 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.155155 Jun 02 13:59:24.934601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 265/560] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:24 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:59:25.951328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-201ecb88-acf8-416d-b92c-75ffc201cc34 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:25.951948 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-201ecb88-acf8-416d-b92c-75ffc201cc34 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:25.958310 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-201ecb88-acf8-416d-b92c-75ffc201cc34 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:25.958755 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-201ecb88-acf8-416d-b92c-75ffc201cc34 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:25.959499 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-201ecb88-acf8-416d-b92c-75ffc201cc34 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:25.959926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-201ecb88-acf8-416d-b92c-75ffc201cc34 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:26.088386 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-201ecb88-acf8-416d-b92c-75ffc201cc34 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:26.097403 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-201ecb88-acf8-416d-b92c-75ffc201cc34 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:26.098903 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-201ecb88-acf8-416d-b92c-75ffc201cc34 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:26.100066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-201ecb88-acf8-416d-b92c-75ffc201cc34 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.152897 Jun 02 13:59:26.100639 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 296/561] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:25 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:59:27.118829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c214ec3b-0879-43db-ac58-4ea0c9a72f50 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:27.119379 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c214ec3b-0879-43db-ac58-4ea0c9a72f50 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:27.126489 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c214ec3b-0879-43db-ac58-4ea0c9a72f50 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:27.126943 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c214ec3b-0879-43db-ac58-4ea0c9a72f50 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:27.127690 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c214ec3b-0879-43db-ac58-4ea0c9a72f50 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:27.128117 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c214ec3b-0879-43db-ac58-4ea0c9a72f50 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:27.259582 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c214ec3b-0879-43db-ac58-4ea0c9a72f50 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:27.268417 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c214ec3b-0879-43db-ac58-4ea0c9a72f50 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:27.269935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c214ec3b-0879-43db-ac58-4ea0c9a72f50 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:27.271090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c214ec3b-0879-43db-ac58-4ea0c9a72f50 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.156289 Jun 02 13:59:27.271642 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 266/562] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:27 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:59:28.289654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-84ac353f-4848-483c-ae15-362a3bdd33fd tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:28.290260 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-84ac353f-4848-483c-ae15-362a3bdd33fd tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:28.299364 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84ac353f-4848-483c-ae15-362a3bdd33fd tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:28.299811 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84ac353f-4848-483c-ae15-362a3bdd33fd tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:28.300605 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84ac353f-4848-483c-ae15-362a3bdd33fd tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:28.301032 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84ac353f-4848-483c-ae15-362a3bdd33fd tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:28.435422 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-84ac353f-4848-483c-ae15-362a3bdd33fd tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:28.444738 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-84ac353f-4848-483c-ae15-362a3bdd33fd tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:28.446194 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-84ac353f-4848-483c-ae15-362a3bdd33fd tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:28.447383 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-84ac353f-4848-483c-ae15-362a3bdd33fd tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.161770 Jun 02 13:59:28.447990 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 297/563] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:28 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:59:29.465762 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-49b0e80b-ea3b-4df1-898e-c9ad02f970b4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:29.466972 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-49b0e80b-ea3b-4df1-898e-c9ad02f970b4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:29.478533 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-49b0e80b-ea3b-4df1-898e-c9ad02f970b4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:29.478533 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-49b0e80b-ea3b-4df1-898e-c9ad02f970b4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:29.479268 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-49b0e80b-ea3b-4df1-898e-c9ad02f970b4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:29.479700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-49b0e80b-ea3b-4df1-898e-c9ad02f970b4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:29.612976 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-49b0e80b-ea3b-4df1-898e-c9ad02f970b4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:29.621357 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-49b0e80b-ea3b-4df1-898e-c9ad02f970b4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:29.622941 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-49b0e80b-ea3b-4df1-898e-c9ad02f970b4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:29.624068 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-49b0e80b-ea3b-4df1-898e-c9ad02f970b4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.162468 Jun 02 13:59:29.624673 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 267/564] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:29 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:59:30.034501 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c16fe3d7-df2a-4618-864e-e17352285517 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:30.035151 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c16fe3d7-df2a-4618-864e-e17352285517 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:30.041290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c16fe3d7-df2a-4618-864e-e17352285517 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:30.041733 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c16fe3d7-df2a-4618-864e-e17352285517 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:30.042492 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c16fe3d7-df2a-4618-864e-e17352285517 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:30.042920 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c16fe3d7-df2a-4618-864e-e17352285517 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:30.181792 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c16fe3d7-df2a-4618-864e-e17352285517 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:30.192432 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c16fe3d7-df2a-4618-864e-e17352285517 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1594 microversion: 2.1 time: 0.161684 Jun 02 13:59:30.193331 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 298/565] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:30 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1594 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:30.642907 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-6bffc00b-75d0-420d-8c52-2fb5d884fef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:30.643491 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-6bffc00b-75d0-420d-8c52-2fb5d884fef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:30.649966 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6bffc00b-75d0-420d-8c52-2fb5d884fef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:30.650407 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6bffc00b-75d0-420d-8c52-2fb5d884fef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:30.651158 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6bffc00b-75d0-420d-8c52-2fb5d884fef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:30.651584 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6bffc00b-75d0-420d-8c52-2fb5d884fef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:30.815749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6bffc00b-75d0-420d-8c52-2fb5d884fef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:30.826207 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6bffc00b-75d0-420d-8c52-2fb5d884fef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:30.827702 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6bffc00b-75d0-420d-8c52-2fb5d884fef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:30.828926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-6bffc00b-75d0-420d-8c52-2fb5d884fef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.190649 Jun 02 13:59:30.830186 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 268/566] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:30 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:59:31.167697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-53a8edfb-6f08-4ea9-bf2c-941b5cbbf551 req-a3d8ec1c-cab7-440b-bf61-512df417b027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d462ae-af14-4d5d-aab2-f45954429480", "name": "network-vif-plugged", "status": "completed", "tag": "9494633c-b230-4406-ab57-d1f3d39fc4d6"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:59:31.177216 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-53a8edfb-6f08-4ea9-bf2c-941b5cbbf551 req-a3d8ec1c-cab7-440b-bf61-512df417b027 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:31.177660 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-53a8edfb-6f08-4ea9-bf2c-941b5cbbf551 req-a3d8ec1c-cab7-440b-bf61-512df417b027 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:31.189740 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-53a8edfb-6f08-4ea9-bf2c-941b5cbbf551 req-a3d8ec1c-cab7-440b-bf61-512df417b027 service nova] Creating event network-vif-plugged:9494633c-b230-4406-ab57-d1f3d39fc4d6 for instance 83d462ae-af14-4d5d-aab2-f45954429480 on hv-cinder-82651 Jun 02 13:59:31.194860 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-53a8edfb-6f08-4ea9-bf2c-941b5cbbf551 req-a3d8ec1c-cab7-440b-bf61-512df417b027 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030977 Jun 02 13:59:31.195619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 299/567] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:59:31.848796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-686d8c14-e906-489f-947a-88664268f93f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:31.849456 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-686d8c14-e906-489f-947a-88664268f93f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:31.864179 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-686d8c14-e906-489f-947a-88664268f93f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:31.864670 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-686d8c14-e906-489f-947a-88664268f93f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:31.865444 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-686d8c14-e906-489f-947a-88664268f93f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:31.865866 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-686d8c14-e906-489f-947a-88664268f93f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:32.129702 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-686d8c14-e906-489f-947a-88664268f93f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:32.140039 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-686d8c14-e906-489f-947a-88664268f93f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:32.142352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-686d8c14-e906-489f-947a-88664268f93f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:32.143661 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-686d8c14-e906-489f-947a-88664268f93f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.299618 Jun 02 13:59:32.144307 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 269/568] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:31 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:59:32.512315 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-f22564e7-8812-4c68-93e0-9313eed6d6de req-72b2e4ee-537e-45dc-bb29-eaded5519b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "783eae57-62e0-4101-ae12-14b73c9f87db", "tag": "206884cb-c7bb-4476-9320-75dc2245d246"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:59:32.522682 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-f22564e7-8812-4c68-93e0-9313eed6d6de req-72b2e4ee-537e-45dc-bb29-eaded5519b27 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:32.523151 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-f22564e7-8812-4c68-93e0-9313eed6d6de req-72b2e4ee-537e-45dc-bb29-eaded5519b27 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:32.534622 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-f22564e7-8812-4c68-93e0-9313eed6d6de req-72b2e4ee-537e-45dc-bb29-eaded5519b27 service nova] Creating event network-changed:206884cb-c7bb-4476-9320-75dc2245d246 for instance 783eae57-62e0-4101-ae12-14b73c9f87db on hv-cinder-82651 Jun 02 13:59:32.539484 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-f22564e7-8812-4c68-93e0-9313eed6d6de req-72b2e4ee-537e-45dc-bb29-eaded5519b27 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097324 Jun 02 13:59:32.540349 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 300/569] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:59:32.953433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-62660b71-5984-40dc-ba1a-28292d8fa0be tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:32.954009 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-62660b71-5984-40dc-ba1a-28292d8fa0be tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:32.961538 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-62660b71-5984-40dc-ba1a-28292d8fa0be tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:32.962014 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-62660b71-5984-40dc-ba1a-28292d8fa0be tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:32.962787 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-62660b71-5984-40dc-ba1a-28292d8fa0be tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:32.963222 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-62660b71-5984-40dc-ba1a-28292d8fa0be tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:32.989891 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-62660b71-5984-40dc-ba1a-28292d8fa0be tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f/ips" status: 200 len: 150 microversion: 2.1 time: 0.040642 Jun 02 13:59:32.990554 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 270/570] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 2 13:59:32 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:59:33.163831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5b061c46-3a6c-455b-adac-bae8eb81b798 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:33.165161 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5b061c46-3a6c-455b-adac-bae8eb81b798 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:33.173245 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5b061c46-3a6c-455b-adac-bae8eb81b798 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:33.174197 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5b061c46-3a6c-455b-adac-bae8eb81b798 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:33.174987 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5b061c46-3a6c-455b-adac-bae8eb81b798 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:33.175590 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5b061c46-3a6c-455b-adac-bae8eb81b798 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:33.217131 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0dd3d6cc-ee36-4de2-adc6-47b8c346ac05 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baa53ff6-3031-4592-9243-4bebe48b2efd"}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:59:33.218415 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0dd3d6cc-ee36-4de2-adc6-47b8c346ac05 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:33.233089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0dd3d6cc-ee36-4de2-adc6-47b8c346ac05 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:33.233089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0dd3d6cc-ee36-4de2-adc6-47b8c346ac05 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:33.233089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0dd3d6cc-ee36-4de2-adc6-47b8c346ac05 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:33.233089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0dd3d6cc-ee36-4de2-adc6-47b8c346ac05 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:33.334188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5b061c46-3a6c-455b-adac-bae8eb81b798 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:33.356022 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5b061c46-3a6c-455b-adac-bae8eb81b798 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:33.357566 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5b061c46-3a6c-455b-adac-bae8eb81b798 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:33.358765 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5b061c46-3a6c-455b-adac-bae8eb81b798 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.199498 Jun 02 13:59:33.359312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 271/571] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:33 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:34.377550 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-23455501-34d5-422a-9cf3-d358fa29574b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:34.378191 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-23455501-34d5-422a-9cf3-d358fa29574b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:34.385034 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-23455501-34d5-422a-9cf3-d358fa29574b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:34.385570 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-23455501-34d5-422a-9cf3-d358fa29574b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:34.386601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-23455501-34d5-422a-9cf3-d358fa29574b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:34.387097 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-23455501-34d5-422a-9cf3-d358fa29574b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:34.521123 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-23455501-34d5-422a-9cf3-d358fa29574b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:34.529809 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-23455501-34d5-422a-9cf3-d358fa29574b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:34.531353 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-23455501-34d5-422a-9cf3-d358fa29574b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:34.533174 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-23455501-34d5-422a-9cf3-d358fa29574b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.159872 Jun 02 13:59:34.533731 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 272/572] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:34 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:34.838432 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0dd3d6cc-ee36-4de2-adc6-47b8c346ac05 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "POST /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.747059 Jun 02 13:59:34.839250 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 301/573] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 2 13:59:33 2022] POST /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments => generated 194 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:59:35.520966 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b3cd1061-64c1-4161-b297-d3261840a138 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1162069593"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:59:35.521511 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b3cd1061-64c1-4161-b297-d3261840a138 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:35.528198 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b3cd1061-64c1-4161-b297-d3261840a138 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:35.528663 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b3cd1061-64c1-4161-b297-d3261840a138 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:35.529422 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b3cd1061-64c1-4161-b297-d3261840a138 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:35.529858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b3cd1061-64c1-4161-b297-d3261840a138 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:35.552750 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d31ac3f8-7b27-453a-911a-194a777b23f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:35.553810 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d31ac3f8-7b27-453a-911a-194a777b23f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:35.560692 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d31ac3f8-7b27-453a-911a-194a777b23f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:35.561140 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d31ac3f8-7b27-453a-911a-194a777b23f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:35.561895 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d31ac3f8-7b27-453a-911a-194a777b23f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:35.562323 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d31ac3f8-7b27-453a-911a-194a777b23f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:35.700990 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.network.security_group_api [None req-b3cd1061-64c1-4161-b297-d3261840a138 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Adding security group 6d528ef8-9e7d-4c25-8221-803e6b1ecc46 to port 206884cb-c7bb-4476-9320-75dc2245d246 Jun 02 13:59:35.779944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d31ac3f8-7b27-453a-911a-194a777b23f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:35.789247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d31ac3f8-7b27-453a-911a-194a777b23f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:35.790736 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d31ac3f8-7b27-453a-911a-194a777b23f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:35.791886 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d31ac3f8-7b27-453a-911a-194a777b23f7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.244488 Jun 02 13:59:35.792456 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 302/574] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:35 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:35.921440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-cc91ea3c-37f1-4f56-80b2-7aa266414d1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3174d151-d953-4324-b56e-688b2d07d880"}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:59:35.922718 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-cc91ea3c-37f1-4f56-80b2-7aa266414d1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:35.930502 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cc91ea3c-37f1-4f56-80b2-7aa266414d1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:35.932568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cc91ea3c-37f1-4f56-80b2-7aa266414d1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:35.933593 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cc91ea3c-37f1-4f56-80b2-7aa266414d1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:35.934679 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cc91ea3c-37f1-4f56-80b2-7aa266414d1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:36.267523 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b3cd1061-64c1-4161-b297-d3261840a138 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "POST /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/action" status: 202 len: 0 microversion: 2.1 time: 0.750536 Jun 02 13:59:36.272172 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 273/575] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 2 13:59:35 2022] POST /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 13:59:36.277375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-121f830b-80f2-45c3-be41-92a59db6a685 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:36.278004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-121f830b-80f2-45c3-be41-92a59db6a685 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:36.288207 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-121f830b-80f2-45c3-be41-92a59db6a685 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:36.289123 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-121f830b-80f2-45c3-be41-92a59db6a685 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:36.297019 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-121f830b-80f2-45c3-be41-92a59db6a685 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:36.297019 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-121f830b-80f2-45c3-be41-92a59db6a685 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:36.459834 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-121f830b-80f2-45c3-be41-92a59db6a685 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:36.471001 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-121f830b-80f2-45c3-be41-92a59db6a685 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1760 microversion: 2.1 time: 0.196990 Jun 02 13:59:36.471614 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 274/576] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:36 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1760 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:36.476566 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-9a9118e9-71a6-4139-9ae7-a041584af613 req-aab1af8c-c8c9-4a79-b099-e102db16ee96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "783eae57-62e0-4101-ae12-14b73c9f87db", "tag": "206884cb-c7bb-4476-9320-75dc2245d246"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:59:36.484838 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-9a9118e9-71a6-4139-9ae7-a041584af613 req-aab1af8c-c8c9-4a79-b099-e102db16ee96 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:36.486433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-9a9118e9-71a6-4139-9ae7-a041584af613 req-aab1af8c-c8c9-4a79-b099-e102db16ee96 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:36.499636 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-9a9118e9-71a6-4139-9ae7-a041584af613 req-aab1af8c-c8c9-4a79-b099-e102db16ee96 service nova] Creating event network-changed:206884cb-c7bb-4476-9320-75dc2245d246 for instance 783eae57-62e0-4101-ae12-14b73c9f87db on hv-cinder-82651 Jun 02 13:59:36.506343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-9a9118e9-71a6-4139-9ae7-a041584af613 req-aab1af8c-c8c9-4a79-b099-e102db16ee96 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033370 Jun 02 13:59:36.507043 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 275/577] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 13:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:59:36.811439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d9c37486-9090-4f3e-8966-9cc4e6c54a76 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:36.812248 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d9c37486-9090-4f3e-8966-9cc4e6c54a76 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:36.819173 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d9c37486-9090-4f3e-8966-9cc4e6c54a76 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:36.819610 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d9c37486-9090-4f3e-8966-9cc4e6c54a76 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:36.820388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d9c37486-9090-4f3e-8966-9cc4e6c54a76 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:36.820846 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d9c37486-9090-4f3e-8966-9cc4e6c54a76 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:36.963033 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d9c37486-9090-4f3e-8966-9cc4e6c54a76 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:36.973268 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d9c37486-9090-4f3e-8966-9cc4e6c54a76 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:36.974734 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d9c37486-9090-4f3e-8966-9cc4e6c54a76 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:36.975912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d9c37486-9090-4f3e-8966-9cc4e6c54a76 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.169589 Jun 02 13:59:36.976654 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 276/578] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:36 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:59:37.743927 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-cc91ea3c-37f1-4f56-80b2-7aa266414d1d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "POST /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.826624 Jun 02 13:59:37.744567 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 303/579] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 2 13:59:35 2022] POST /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f/os-volume_attachments => generated 194 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:59:37.994573 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-21292da4-7628-463e-a07f-63a53acc7fba tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:37.995185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-21292da4-7628-463e-a07f-63a53acc7fba tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:38.002950 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-21292da4-7628-463e-a07f-63a53acc7fba tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:38.003398 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-21292da4-7628-463e-a07f-63a53acc7fba tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:38.004159 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-21292da4-7628-463e-a07f-63a53acc7fba tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:38.004622 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-21292da4-7628-463e-a07f-63a53acc7fba tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:38.153464 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-21292da4-7628-463e-a07f-63a53acc7fba tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:38.162551 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-21292da4-7628-463e-a07f-63a53acc7fba tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:38.164068 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-21292da4-7628-463e-a07f-63a53acc7fba tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:38.165266 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-21292da4-7628-463e-a07f-63a53acc7fba tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1808 microversion: 2.20 time: 0.174662 Jun 02 13:59:38.165902 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 277/580] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:37 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:59:39.184615 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-68357287-a66b-4f55-950a-ccf93738c3a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:39.185308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-68357287-a66b-4f55-950a-ccf93738c3a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:39.188091 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=44 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:39.194136 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-68357287-a66b-4f55-950a-ccf93738c3a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:39.194575 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-68357287-a66b-4f55-950a-ccf93738c3a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:39.195361 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-68357287-a66b-4f55-950a-ccf93738c3a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:39.195786 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-68357287-a66b-4f55-950a-ccf93738c3a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:39.328507 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-68357287-a66b-4f55-950a-ccf93738c3a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:39.337403 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-68357287-a66b-4f55-950a-ccf93738c3a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:39.339000 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-68357287-a66b-4f55-950a-ccf93738c3a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:39.340082 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-68357287-a66b-4f55-950a-ccf93738c3a1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1795 microversion: 2.20 time: 0.159790 Jun 02 13:59:39.340665 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 304/581] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 13:59:39 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:59:45.514067 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d530d68d-ffb2-4f8f-a57a-6d1169212c96 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:59:45.515016 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d530d68d-ffb2-4f8f-a57a-6d1169212c96 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:45.522802 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d530d68d-ffb2-4f8f-a57a-6d1169212c96 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:45.523250 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d530d68d-ffb2-4f8f-a57a-6d1169212c96 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:45.524015 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d530d68d-ffb2-4f8f-a57a-6d1169212c96 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:45.524484 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d530d68d-ffb2-4f8f-a57a-6d1169212c96 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:45.527101 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:45.553813 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-d530d68d-ffb2-4f8f-a57a-6d1169212c96 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lazy-loading 'flavor' on Instance uuid c714d190-39b3-40b8-a7d0-da49a06fe5fa {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:59:45.917563 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d530d68d-ffb2-4f8f-a57a-6d1169212c96 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "POST /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/action" status: 200 len: 32 microversion: 2.1 time: 0.407309 Jun 02 13:59:45.918185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 278/582] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 2 13:59:45 2022] POST /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/action => generated 32 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:59:45.928837 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-cfe7ab96-25e9-4d24-9544-21d271f1de07 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:45.929450 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-cfe7ab96-25e9-4d24-9544-21d271f1de07 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:45.937407 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cfe7ab96-25e9-4d24-9544-21d271f1de07 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:45.937860 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cfe7ab96-25e9-4d24-9544-21d271f1de07 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:45.938620 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cfe7ab96-25e9-4d24-9544-21d271f1de07 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:45.939049 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cfe7ab96-25e9-4d24-9544-21d271f1de07 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:46.072455 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-cfe7ab96-25e9-4d24-9544-21d271f1de07 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:46.080702 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-cfe7ab96-25e9-4d24-9544-21d271f1de07 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.157249 Jun 02 13:59:46.081218 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 305/583] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:45 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:47.099652 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-6c50fe5c-7045-4cee-bb5d-8a1fe7770aa4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:47.100342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-6c50fe5c-7045-4cee-bb5d-8a1fe7770aa4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:47.106626 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6c50fe5c-7045-4cee-bb5d-8a1fe7770aa4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:47.107074 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6c50fe5c-7045-4cee-bb5d-8a1fe7770aa4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:47.107856 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6c50fe5c-7045-4cee-bb5d-8a1fe7770aa4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:47.108290 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6c50fe5c-7045-4cee-bb5d-8a1fe7770aa4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:47.238736 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6c50fe5c-7045-4cee-bb5d-8a1fe7770aa4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:47.248565 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-6c50fe5c-7045-4cee-bb5d-8a1fe7770aa4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.152388 Jun 02 13:59:47.248565 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 279/584] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:47 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:48.265634 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-98efcd8d-afb2-44de-afe7-293bd5348183 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:48.266264 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-98efcd8d-afb2-44de-afe7-293bd5348183 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:48.273631 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-98efcd8d-afb2-44de-afe7-293bd5348183 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:48.274106 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-98efcd8d-afb2-44de-afe7-293bd5348183 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:48.274853 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-98efcd8d-afb2-44de-afe7-293bd5348183 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:48.275275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-98efcd8d-afb2-44de-afe7-293bd5348183 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:48.408742 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-98efcd8d-afb2-44de-afe7-293bd5348183 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:48.417809 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-98efcd8d-afb2-44de-afe7-293bd5348183 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.156088 Jun 02 13:59:48.418372 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 306/585] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:48 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:49.434145 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d2e4a12e-bce6-4e78-a6a5-e4c012a14a02 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:49.434764 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d2e4a12e-bce6-4e78-a6a5-e4c012a14a02 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:49.441206 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d2e4a12e-bce6-4e78-a6a5-e4c012a14a02 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:49.441651 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d2e4a12e-bce6-4e78-a6a5-e4c012a14a02 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:49.442482 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d2e4a12e-bce6-4e78-a6a5-e4c012a14a02 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:49.442914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d2e4a12e-bce6-4e78-a6a5-e4c012a14a02 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:49.572426 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d2e4a12e-bce6-4e78-a6a5-e4c012a14a02 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:49.580589 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d2e4a12e-bce6-4e78-a6a5-e4c012a14a02 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.150234 Jun 02 13:59:49.581166 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 280/586] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:49 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:59:50.597771 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ba058459-afb7-492d-be0c-c622212ce69e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:50.598537 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ba058459-afb7-492d-be0c-c622212ce69e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:50.604980 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ba058459-afb7-492d-be0c-c622212ce69e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:50.605427 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ba058459-afb7-492d-be0c-c622212ce69e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:50.606186 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ba058459-afb7-492d-be0c-c622212ce69e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:50.606616 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ba058459-afb7-492d-be0c-c622212ce69e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:50.610513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:50.734550 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ba058459-afb7-492d-be0c-c622212ce69e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:50.742962 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ba058459-afb7-492d-be0c-c622212ce69e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.149031 Jun 02 13:59:50.743523 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 307/587] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:50 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:51.760242 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-167561de-8688-43e6-b714-4fa5b358260b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:51.760818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-167561de-8688-43e6-b714-4fa5b358260b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:51.767271 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-167561de-8688-43e6-b714-4fa5b358260b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:51.767713 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-167561de-8688-43e6-b714-4fa5b358260b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:51.768487 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-167561de-8688-43e6-b714-4fa5b358260b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:51.768913 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-167561de-8688-43e6-b714-4fa5b358260b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:51.904754 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-167561de-8688-43e6-b714-4fa5b358260b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:51.906684 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-167561de-8688-43e6-b714-4fa5b358260b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.150354 Jun 02 13:59:51.907252 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 281/588] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:51 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:52.923593 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6fe8f955-ad7d-46f7-9cb9-f2f67aa4a9ab tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:52.924197 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6fe8f955-ad7d-46f7-9cb9-f2f67aa4a9ab tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:52.931414 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6fe8f955-ad7d-46f7-9cb9-f2f67aa4a9ab tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:52.931898 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6fe8f955-ad7d-46f7-9cb9-f2f67aa4a9ab tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:52.932699 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6fe8f955-ad7d-46f7-9cb9-f2f67aa4a9ab tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:52.933161 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6fe8f955-ad7d-46f7-9cb9-f2f67aa4a9ab tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:53.067915 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6fe8f955-ad7d-46f7-9cb9-f2f67aa4a9ab tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:53.076358 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6fe8f955-ad7d-46f7-9cb9-f2f67aa4a9ab tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.156632 Jun 02 13:59:53.076953 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 308/589] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:52 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:53.678475 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7d874918-3830-4d76-be22-fc81be32f7ea tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Action: 'create', calling method: .version_select at 0x7fb71aed5d30>, body: {"keypair": {"name": "tempest-keypair-525634832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXUMMQPhJoae4E43AfIvFmfXS3O4jnHYpR4239sSRbCkEgr6P1oi2imV0rN1OiZrdaE0y9JwavTGUh/X8TrJmlTu8Y9jgfKvEvES7AKZHZmNbD0a/HsxK6bCx9zYTZL7g=="}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:59:53.683056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=37 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:53.694503 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-7d874918-3830-4d76-be22-fc81be32f7ea tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for project 8f72940f7df74b898595c0ed9c654502. Resources: {'key_pairs'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:59:53.698322 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-7d874918-3830-4d76-be22-fc81be32f7ea tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for user b8d05eeb8ac146969b99d33084f1664c and project 8f72940f7df74b898595c0ed9c654502. Resources: {'key_pairs'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:59:53.799614 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7d874918-3830-4d76-be22-fc81be32f7ea tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.125335 Jun 02 13:59:53.800126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 282/590] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 2 13:59:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:59:54.094247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e99aedc0-87ce-4e19-9e01-b4790e2efdc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:54.094864 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e99aedc0-87ce-4e19-9e01-b4790e2efdc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:54.101603 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e99aedc0-87ce-4e19-9e01-b4790e2efdc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:54.102033 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e99aedc0-87ce-4e19-9e01-b4790e2efdc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:54.102836 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e99aedc0-87ce-4e19-9e01-b4790e2efdc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:54.103268 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e99aedc0-87ce-4e19-9e01-b4790e2efdc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:54.239372 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e99aedc0-87ce-4e19-9e01-b4790e2efdc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:54.247676 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e99aedc0-87ce-4e19-9e01-b4790e2efdc5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.157565 Jun 02 13:59:54.248244 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 309/591] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:54 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:55.265254 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3e3802f9-c948-4d7a-85c4-729729afdcca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:55.265916 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3e3802f9-c948-4d7a-85c4-729729afdcca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:55.275156 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3e3802f9-c948-4d7a-85c4-729729afdcca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:55.275535 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3e3802f9-c948-4d7a-85c4-729729afdcca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:55.276394 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3e3802f9-c948-4d7a-85c4-729729afdcca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:55.276960 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3e3802f9-c948-4d7a-85c4-729729afdcca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:55.406489 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3e3802f9-c948-4d7a-85c4-729729afdcca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:55.422708 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3e3802f9-c948-4d7a-85c4-729729afdcca tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.154382 Jun 02 13:59:55.422708 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 283/592] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:55 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:56.265848 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2094942583", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14cc21cb-4d69-474d-9628-4e979c4e6581"}], "security_groups": [{"name": "tempest-securitygroup--1154987417"}], "key_name": "tempest-keypair-525634832", "user_data": "}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:59:56.372081 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.network.neutron [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] validate_networks() for [('14cc21cb-4d69-474d-9628-4e979c4e6581', None, None, None, None, None)] {{(pid=118316) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:59:56.431955 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e84cd534-37f4-4695-a865-199e5fb4557e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:56.432657 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e84cd534-37f4-4695-a865-199e5fb4557e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:56.439208 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e84cd534-37f4-4695-a865-199e5fb4557e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:56.439662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e84cd534-37f4-4695-a865-199e5fb4557e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:56.440453 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e84cd534-37f4-4695-a865-199e5fb4557e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:56.440898 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e84cd534-37f4-4695-a865-199e5fb4557e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:56.638521 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e84cd534-37f4-4695-a865-199e5fb4557e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:56.647506 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e84cd534-37f4-4695-a865-199e5fb4557e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.219209 Jun 02 13:59:56.648168 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 284/593] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:56 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:56.804273 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Flavor limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:59:56.804927 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Image limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:59:56.805408 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Flavor pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:59:56.805811 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Image pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:59:56.806245 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:59:56.814964 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:56.815397 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:56.816173 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:56.816643 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:56.834351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for project 8f72940f7df74b898595c0ed9c654502. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:59:56.838226 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for user b8d05eeb8ac146969b99d33084f1664c and project 8f72940f7df74b898595c0ed9c654502. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:59:56.849219 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Going to run 1 instances... {{(pid=118316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:59:56.851439 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:59:56.998508 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d0bdcc9b-031b-474e-be87-988a72b78ec3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.736978 Jun 02 13:59:56.999203 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 310/594] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 13:59:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:59:57.011753 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-116504d6-a429-4668-9dcf-f4ba528b1e0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:57.012702 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-116504d6-a429-4668-9dcf-f4ba528b1e0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:57.076758 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-116504d6-a429-4668-9dcf-f4ba528b1e0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:57.083805 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-116504d6-a429-4668-9dcf-f4ba528b1e0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1241 microversion: 2.1 time: 0.077862 Jun 02 13:59:57.084594 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 285/595] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:57 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:57.665252 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-efef5ca5-4228-4280-ae38-371bbd4884db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:57.665891 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-efef5ca5-4228-4280-ae38-371bbd4884db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:57.672493 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-efef5ca5-4228-4280-ae38-371bbd4884db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:57.672940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-efef5ca5-4228-4280-ae38-371bbd4884db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:57.673690 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-efef5ca5-4228-4280-ae38-371bbd4884db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:57.674121 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-efef5ca5-4228-4280-ae38-371bbd4884db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:57.804153 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-efef5ca5-4228-4280-ae38-371bbd4884db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:57.812116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-efef5ca5-4228-4280-ae38-371bbd4884db tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.152294 Jun 02 13:59:57.812730 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 311/596] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:57 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:58.102102 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7db39d9b-ab61-4c1d-8324-45e40294f575 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:58.102721 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7db39d9b-ab61-4c1d-8324-45e40294f575 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:58.109814 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7db39d9b-ab61-4c1d-8324-45e40294f575 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:58.110458 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7db39d9b-ab61-4c1d-8324-45e40294f575 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:58.111222 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7db39d9b-ab61-4c1d-8324-45e40294f575 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:58.111656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7db39d9b-ab61-4c1d-8324-45e40294f575 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:58.174191 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7db39d9b-ab61-4c1d-8324-45e40294f575 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:58.181916 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7db39d9b-ab61-4c1d-8324-45e40294f575 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1245 microversion: 2.1 time: 0.084734 Jun 02 13:59:58.182479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 286/597] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:58 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:58.829197 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f3c6b3f9-408b-42e3-8b5c-ac717f5ba3b7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:58.829814 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f3c6b3f9-408b-42e3-8b5c-ac717f5ba3b7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:58.836868 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f3c6b3f9-408b-42e3-8b5c-ac717f5ba3b7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:58.837345 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f3c6b3f9-408b-42e3-8b5c-ac717f5ba3b7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:58.838148 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f3c6b3f9-408b-42e3-8b5c-ac717f5ba3b7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:58.838629 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f3c6b3f9-408b-42e3-8b5c-ac717f5ba3b7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:59.162255 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f3c6b3f9-408b-42e3-8b5c-ac717f5ba3b7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:59.170106 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f3c6b3f9-408b-42e3-8b5c-ac717f5ba3b7 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.344877 Jun 02 13:59:59.170693 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 312/598] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:58 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:59:59.199257 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e7bfbb75-6015-447f-a5fa-ca7a2640936b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:59:59.199866 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e7bfbb75-6015-447f-a5fa-ca7a2640936b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:59:59.206006 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7bfbb75-6015-447f-a5fa-ca7a2640936b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:59.206444 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7bfbb75-6015-447f-a5fa-ca7a2640936b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:59.207191 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7bfbb75-6015-447f-a5fa-ca7a2640936b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:59:59.208384 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7bfbb75-6015-447f-a5fa-ca7a2640936b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:59:59.268334 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e7bfbb75-6015-447f-a5fa-ca7a2640936b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:59:59.276427 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e7bfbb75-6015-447f-a5fa-ca7a2640936b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1293 microversion: 2.1 time: 0.081190 Jun 02 13:59:59.276998 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 287/599] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 13:59:59 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:00.187106 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-caaa2b30-0d03-4292-a3a9-45dffa9e1f79 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:00.187809 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-caaa2b30-0d03-4292-a3a9-45dffa9e1f79 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:00.194302 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-caaa2b30-0d03-4292-a3a9-45dffa9e1f79 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:00.194743 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-caaa2b30-0d03-4292-a3a9-45dffa9e1f79 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:00.195494 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-caaa2b30-0d03-4292-a3a9-45dffa9e1f79 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:00.195920 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-caaa2b30-0d03-4292-a3a9-45dffa9e1f79 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:00.295353 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-cbb294ac-7151-4dfd-b1ec-74b9d77577fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:00.296137 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-cbb294ac-7151-4dfd-b1ec-74b9d77577fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:00.304642 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cbb294ac-7151-4dfd-b1ec-74b9d77577fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:00.305089 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cbb294ac-7151-4dfd-b1ec-74b9d77577fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:00.308090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cbb294ac-7151-4dfd-b1ec-74b9d77577fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:00.308090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cbb294ac-7151-4dfd-b1ec-74b9d77577fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:00.335866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-caaa2b30-0d03-4292-a3a9-45dffa9e1f79 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:00.344201 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-caaa2b30-0d03-4292-a3a9-45dffa9e1f79 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.161041 Jun 02 14:00:00.344905 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 313/600] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:00 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:00.385171 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-cbb294ac-7151-4dfd-b1ec-74b9d77577fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:00.392700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-cbb294ac-7151-4dfd-b1ec-74b9d77577fa tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1299 microversion: 2.1 time: 0.102253 Jun 02 14:00:00.393269 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 288/601] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:00 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:00:01.363284 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2b3e9fab-c273-464c-9b13-12ca08044ee8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:01.364797 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2b3e9fab-c273-464c-9b13-12ca08044ee8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:01.373714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2b3e9fab-c273-464c-9b13-12ca08044ee8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:01.374400 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2b3e9fab-c273-464c-9b13-12ca08044ee8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:01.375578 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2b3e9fab-c273-464c-9b13-12ca08044ee8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:01.376247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2b3e9fab-c273-464c-9b13-12ca08044ee8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:01.411106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ae30f465-e832-4245-9aa4-a8a78f1e8dc2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:01.412911 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ae30f465-e832-4245-9aa4-a8a78f1e8dc2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:01.419622 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ae30f465-e832-4245-9aa4-a8a78f1e8dc2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:01.420140 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ae30f465-e832-4245-9aa4-a8a78f1e8dc2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:01.420992 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ae30f465-e832-4245-9aa4-a8a78f1e8dc2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:01.421434 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ae30f465-e832-4245-9aa4-a8a78f1e8dc2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:01.570549 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2b3e9fab-c273-464c-9b13-12ca08044ee8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:01.579100 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2b3e9fab-c273-464c-9b13-12ca08044ee8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.219686 Jun 02 14:00:01.579694 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 314/602] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:01 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:01.611418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ae30f465-e832-4245-9aa4-a8a78f1e8dc2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:01.621975 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ae30f465-e832-4245-9aa4-a8a78f1e8dc2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1367 microversion: 2.1 time: 0.215189 Jun 02 14:00:01.628555 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 289/603] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:01 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:01.658809 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-ec421952-1298-44d6-824d-ca2ed51826af req-dd99cd61-58f0-4399-a353-2830c8661e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6d1d51b-029d-43f1-ba8b-15f5ce6211e2", "tag": "fd0e9007-c941-4e85-8d7d-de310b3e3208"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:00:01.668374 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-ec421952-1298-44d6-824d-ca2ed51826af req-dd99cd61-58f0-4399-a353-2830c8661e00 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:01.668846 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-ec421952-1298-44d6-824d-ca2ed51826af req-dd99cd61-58f0-4399-a353-2830c8661e00 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:01.680683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-ec421952-1298-44d6-824d-ca2ed51826af req-dd99cd61-58f0-4399-a353-2830c8661e00 service nova] Creating event network-changed:fd0e9007-c941-4e85-8d7d-de310b3e3208 for instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 on hv-cinder-82651 Jun 02 14:00:01.686383 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-ec421952-1298-44d6-824d-ca2ed51826af req-dd99cd61-58f0-4399-a353-2830c8661e00 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105461 Jun 02 14:00:01.687519 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 315/604] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:00:02.597623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f3d6c14f-0d9d-4ad1-aeb3-def428b5e48e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:02.601210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f3d6c14f-0d9d-4ad1-aeb3-def428b5e48e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:02.605672 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f3d6c14f-0d9d-4ad1-aeb3-def428b5e48e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:02.606118 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f3d6c14f-0d9d-4ad1-aeb3-def428b5e48e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:02.606882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f3d6c14f-0d9d-4ad1-aeb3-def428b5e48e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:02.607317 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f3d6c14f-0d9d-4ad1-aeb3-def428b5e48e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:02.676610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3884c67a-d007-42f5-bb88-d9505ad6e742 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:02.676610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3884c67a-d007-42f5-bb88-d9505ad6e742 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:02.676610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3884c67a-d007-42f5-bb88-d9505ad6e742 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:02.676610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3884c67a-d007-42f5-bb88-d9505ad6e742 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:02.677486 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3884c67a-d007-42f5-bb88-d9505ad6e742 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:02.677486 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3884c67a-d007-42f5-bb88-d9505ad6e742 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:02.806053 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f3d6c14f-0d9d-4ad1-aeb3-def428b5e48e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:02.814045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f3d6c14f-0d9d-4ad1-aeb3-def428b5e48e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.220354 Jun 02 14:00:02.814606 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 290/605] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:02 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:02.834351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3884c67a-d007-42f5-bb88-d9505ad6e742 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:02.841728 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3884c67a-d007-42f5-bb88-d9505ad6e742 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1367 microversion: 2.1 time: 0.204717 Jun 02 14:00:02.842287 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 316/606] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:02 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:00:03.831412 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-bef16a76-2a53-492f-8650-0d0e31de2a4f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:03.831946 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-bef16a76-2a53-492f-8650-0d0e31de2a4f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:03.838911 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bef16a76-2a53-492f-8650-0d0e31de2a4f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:03.839351 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bef16a76-2a53-492f-8650-0d0e31de2a4f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:03.840130 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bef16a76-2a53-492f-8650-0d0e31de2a4f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:03.840589 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bef16a76-2a53-492f-8650-0d0e31de2a4f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:03.858612 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2fdb48e7-1966-49e1-84dd-7e574de40f2d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:03.859296 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2fdb48e7-1966-49e1-84dd-7e574de40f2d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:03.865387 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2fdb48e7-1966-49e1-84dd-7e574de40f2d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:03.867601 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2fdb48e7-1966-49e1-84dd-7e574de40f2d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:03.867601 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2fdb48e7-1966-49e1-84dd-7e574de40f2d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:03.867601 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2fdb48e7-1966-49e1-84dd-7e574de40f2d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:04.041812 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-bef16a76-2a53-492f-8650-0d0e31de2a4f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:04.045942 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2fdb48e7-1966-49e1-84dd-7e574de40f2d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:04.049828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-bef16a76-2a53-492f-8650-0d0e31de2a4f tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.222398 Jun 02 14:00:04.050393 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 291/607] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:03 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:04.053661 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2fdb48e7-1966-49e1-84dd-7e574de40f2d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1367 microversion: 2.1 time: 0.198976 Jun 02 14:00:04.054307 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 317/608] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:03 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:00:05.067291 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f327dfef-e624-4323-a343-adcd917a088d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:05.067905 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f327dfef-e624-4323-a343-adcd917a088d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:05.071166 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-21a70470-82e0-4f7d-b5c7-62c57291c2a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:05.071796 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-21a70470-82e0-4f7d-b5c7-62c57291c2a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:05.077136 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f327dfef-e624-4323-a343-adcd917a088d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:05.077587 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f327dfef-e624-4323-a343-adcd917a088d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:05.078356 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f327dfef-e624-4323-a343-adcd917a088d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:05.078651 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21a70470-82e0-4f7d-b5c7-62c57291c2a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:05.078844 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f327dfef-e624-4323-a343-adcd917a088d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:05.079109 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21a70470-82e0-4f7d-b5c7-62c57291c2a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:05.079882 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21a70470-82e0-4f7d-b5c7-62c57291c2a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:05.080321 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21a70470-82e0-4f7d-b5c7-62c57291c2a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:05.274104 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f327dfef-e624-4323-a343-adcd917a088d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:05.276987 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-21a70470-82e0-4f7d-b5c7-62c57291c2a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:05.282215 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f327dfef-e624-4323-a343-adcd917a088d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.219069 Jun 02 14:00:05.282813 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 292/609] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:05 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:05.284379 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-21a70470-82e0-4f7d-b5c7-62c57291c2a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1367 microversion: 2.1 time: 0.218956 Jun 02 14:00:05.284963 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 318/610] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:05 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:00:06.300070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f0843bac-0f19-4dc4-a838-2389050bd5c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:06.300715 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f0843bac-0f19-4dc4-a838-2389050bd5c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:06.303229 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-daf4a4ce-3c7b-4103-be07-7eadaa6696b2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:06.303847 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-daf4a4ce-3c7b-4103-be07-7eadaa6696b2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:06.308727 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f0843bac-0f19-4dc4-a838-2389050bd5c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:06.309196 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f0843bac-0f19-4dc4-a838-2389050bd5c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:06.309976 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f0843bac-0f19-4dc4-a838-2389050bd5c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:06.310412 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f0843bac-0f19-4dc4-a838-2389050bd5c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:06.311155 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-daf4a4ce-3c7b-4103-be07-7eadaa6696b2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:06.311602 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-daf4a4ce-3c7b-4103-be07-7eadaa6696b2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:06.312397 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-daf4a4ce-3c7b-4103-be07-7eadaa6696b2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:06.312847 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-daf4a4ce-3c7b-4103-be07-7eadaa6696b2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:06.537957 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f0843bac-0f19-4dc4-a838-2389050bd5c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:06.544342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f0843bac-0f19-4dc4-a838-2389050bd5c9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.248173 Jun 02 14:00:06.548969 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 293/611] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:06 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:06.549194 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-daf4a4ce-3c7b-4103-be07-7eadaa6696b2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:06.554911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-daf4a4ce-3c7b-4103-be07-7eadaa6696b2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1367 microversion: 2.1 time: 0.256334 Jun 02 14:00:06.555878 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 319/612] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:06 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:00:07.563862 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-883f18b7-05c2-4e98-96dc-611e5df48451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:07.564505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-883f18b7-05c2-4e98-96dc-611e5df48451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:07.566406 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=6 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:00:07.572491 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0e988e45-332d-4b03-8bb4-86b0b0b140c3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:07.572975 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-883f18b7-05c2-4e98-96dc-611e5df48451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:07.573096 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-883f18b7-05c2-4e98-96dc-611e5df48451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:07.573202 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0e988e45-332d-4b03-8bb4-86b0b0b140c3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:07.574106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-883f18b7-05c2-4e98-96dc-611e5df48451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:07.574544 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-883f18b7-05c2-4e98-96dc-611e5df48451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:07.575281 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:00:07.575970 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=6 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:00:07.581289 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0e988e45-332d-4b03-8bb4-86b0b0b140c3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:07.581732 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0e988e45-332d-4b03-8bb4-86b0b0b140c3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:07.583145 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0e988e45-332d-4b03-8bb4-86b0b0b140c3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:07.583145 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0e988e45-332d-4b03-8bb4-86b0b0b140c3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:07.783395 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-883f18b7-05c2-4e98-96dc-611e5df48451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:07.785662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:00:07.789096 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0e988e45-332d-4b03-8bb4-86b0b0b140c3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:07.793133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-883f18b7-05c2-4e98-96dc-611e5df48451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.233083 Jun 02 14:00:07.793716 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 294/613] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:07 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:07.803649 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0e988e45-332d-4b03-8bb4-86b0b0b140c3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1367 microversion: 2.1 time: 0.234894 Jun 02 14:00:07.804274 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 320/614] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:07 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:00:08.810849 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-739dbe1b-923d-471c-b440-63e40c191cba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:08.811375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-739dbe1b-923d-471c-b440-63e40c191cba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:08.821232 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-739dbe1b-923d-471c-b440-63e40c191cba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:08.821670 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-739dbe1b-923d-471c-b440-63e40c191cba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:08.821804 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ef34517f-f672-4329-aa1e-d23b73d01bfd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:08.822341 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ef34517f-f672-4329-aa1e-d23b73d01bfd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:08.822844 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-739dbe1b-923d-471c-b440-63e40c191cba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:08.823416 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-739dbe1b-923d-471c-b440-63e40c191cba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:08.829543 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ef34517f-f672-4329-aa1e-d23b73d01bfd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:08.829999 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ef34517f-f672-4329-aa1e-d23b73d01bfd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:08.830828 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ef34517f-f672-4329-aa1e-d23b73d01bfd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:08.831259 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ef34517f-f672-4329-aa1e-d23b73d01bfd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:09.020914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-739dbe1b-923d-471c-b440-63e40c191cba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:09.024630 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ef34517f-f672-4329-aa1e-d23b73d01bfd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:09.028863 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-739dbe1b-923d-471c-b440-63e40c191cba tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.222534 Jun 02 14:00:09.029425 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 295/615] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:08 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:09.031967 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ef34517f-f672-4329-aa1e-d23b73d01bfd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1367 microversion: 2.1 time: 0.215188 Jun 02 14:00:09.032547 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 321/616] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:08 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:10.049715 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3eeeeba7-3c64-4af3-82f2-60db7bf1b7dc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:10.050238 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3eeeeba7-3c64-4af3-82f2-60db7bf1b7dc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:10.057466 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-17d72e24-7128-4af6-adf8-1678d0963d87 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:10.062995 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3eeeeba7-3c64-4af3-82f2-60db7bf1b7dc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:10.063154 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-17d72e24-7128-4af6-adf8-1678d0963d87 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:10.063252 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3eeeeba7-3c64-4af3-82f2-60db7bf1b7dc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:10.063252 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3eeeeba7-3c64-4af3-82f2-60db7bf1b7dc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:10.063252 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3eeeeba7-3c64-4af3-82f2-60db7bf1b7dc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:10.063513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:00:10.065830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-17d72e24-7128-4af6-adf8-1678d0963d87 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:10.066277 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-17d72e24-7128-4af6-adf8-1678d0963d87 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:10.067056 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-17d72e24-7128-4af6-adf8-1678d0963d87 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:10.067642 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-17d72e24-7128-4af6-adf8-1678d0963d87 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:10.262253 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3eeeeba7-3c64-4af3-82f2-60db7bf1b7dc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:10.265593 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-17d72e24-7128-4af6-adf8-1678d0963d87 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:10.269923 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3eeeeba7-3c64-4af3-82f2-60db7bf1b7dc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1367 microversion: 2.1 time: 0.224177 Jun 02 14:00:10.270492 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 296/617] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:10 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:10.273705 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-17d72e24-7128-4af6-adf8-1678d0963d87 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.220150 Jun 02 14:00:10.274265 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 322/618] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:10 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:00:10.769838 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-3f8557a1-46fa-4b3d-8035-16a7d9e88f0d req-c8b9871d-af54-4bb7-8458-d0cf0dae6fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d1d51b-029d-43f1-ba8b-15f5ce6211e2", "name": "network-vif-plugged", "status": "completed", "tag": "fd0e9007-c941-4e85-8d7d-de310b3e3208"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:00:10.779009 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-3f8557a1-46fa-4b3d-8035-16a7d9e88f0d req-c8b9871d-af54-4bb7-8458-d0cf0dae6fb0 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:10.779245 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-3f8557a1-46fa-4b3d-8035-16a7d9e88f0d req-c8b9871d-af54-4bb7-8458-d0cf0dae6fb0 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:10.793204 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-3f8557a1-46fa-4b3d-8035-16a7d9e88f0d req-c8b9871d-af54-4bb7-8458-d0cf0dae6fb0 service nova] Creating event network-vif-plugged:fd0e9007-c941-4e85-8d7d-de310b3e3208 for instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 on hv-cinder-82651 Jun 02 14:00:10.798471 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-3f8557a1-46fa-4b3d-8035-16a7d9e88f0d req-c8b9871d-af54-4bb7-8458-d0cf0dae6fb0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092367 Jun 02 14:00:10.799229 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 297/619] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:00:11.288068 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b7216ba0-5e4c-4d79-b217-4771c09d1059 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:11.288858 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b7216ba0-5e4c-4d79-b217-4771c09d1059 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:11.291601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-72aeb297-10f6-4c6b-b79c-f32331c5e1a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:11.293041 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-72aeb297-10f6-4c6b-b79c-f32331c5e1a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:11.295016 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b7216ba0-5e4c-4d79-b217-4771c09d1059 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:11.295475 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b7216ba0-5e4c-4d79-b217-4771c09d1059 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:11.296231 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b7216ba0-5e4c-4d79-b217-4771c09d1059 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:11.296691 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b7216ba0-5e4c-4d79-b217-4771c09d1059 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:11.299666 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-72aeb297-10f6-4c6b-b79c-f32331c5e1a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:11.300119 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-72aeb297-10f6-4c6b-b79c-f32331c5e1a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:11.300947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-72aeb297-10f6-4c6b-b79c-f32331c5e1a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:11.301499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-72aeb297-10f6-4c6b-b79c-f32331c5e1a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:11.495159 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b7216ba0-5e4c-4d79-b217-4771c09d1059 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:11.502900 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b7216ba0-5e4c-4d79-b217-4771c09d1059 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1367 microversion: 2.1 time: 0.219964 Jun 02 14:00:11.503486 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 323/620] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:11 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:11.509729 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-72aeb297-10f6-4c6b-b79c-f32331c5e1a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:11.518086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-72aeb297-10f6-4c6b-b79c-f32331c5e1a2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1732 microversion: 2.1 time: 0.231678 Jun 02 14:00:11.518661 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 298/621] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:11 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1732 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:12.520455 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-384fb7de-3ef2-4f85-8fd2-f12fd55061df tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:12.521498 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-384fb7de-3ef2-4f85-8fd2-f12fd55061df tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:12.527593 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-384fb7de-3ef2-4f85-8fd2-f12fd55061df tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:12.528033 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-384fb7de-3ef2-4f85-8fd2-f12fd55061df tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:12.528809 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-384fb7de-3ef2-4f85-8fd2-f12fd55061df tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:12.529231 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-384fb7de-3ef2-4f85-8fd2-f12fd55061df tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:12.540655 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-df4d60bf-e48e-4548-9917-1081cca630c3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:12.541311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-df4d60bf-e48e-4548-9917-1081cca630c3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:12.549077 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-df4d60bf-e48e-4548-9917-1081cca630c3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:12.549539 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-df4d60bf-e48e-4548-9917-1081cca630c3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:12.550351 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-df4d60bf-e48e-4548-9917-1081cca630c3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:12.550823 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-df4d60bf-e48e-4548-9917-1081cca630c3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:12.737787 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-384fb7de-3ef2-4f85-8fd2-f12fd55061df tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:12.746519 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-df4d60bf-e48e-4548-9917-1081cca630c3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:12.746884 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-384fb7de-3ef2-4f85-8fd2-f12fd55061df tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1367 microversion: 2.1 time: 0.230260 Jun 02 14:00:12.747460 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 324/622] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:12 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:00:12.754501 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-df4d60bf-e48e-4548-9917-1081cca630c3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1712 microversion: 2.1 time: 0.218948 Jun 02 14:00:12.754997 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 299/623] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:12 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1712 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:00:12.821143 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7140f6e4-c7b6-4002-a0b0-2569414952bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:12.821636 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7140f6e4-c7b6-4002-a0b0-2569414952bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:12.827896 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7140f6e4-c7b6-4002-a0b0-2569414952bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:12.828336 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7140f6e4-c7b6-4002-a0b0-2569414952bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:12.829114 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7140f6e4-c7b6-4002-a0b0-2569414952bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:12.829535 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7140f6e4-c7b6-4002-a0b0-2569414952bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:12.858591 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:00:12.952229 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-7140f6e4-c7b6-4002-a0b0-2569414952bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] HTTP exception thrown: Cannot 'detach_volume' instance c714d190-39b3-40b8-a7d0-da49a06fe5fa while it is in vm_state rescued Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7140f6e4-c7b6-4002-a0b0-2569414952bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Request method failure captured: Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: DELETE /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments/baa53ff6-3031-4592-9243-4bebe48b2efd HTTP/1.1 Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMD8es0jslrTw9H8zr0XMa1qVV_2yPyM188swiKF6vue0UYQNpH_rsvPjYaA-2ztdEbY44YK_QxUDWq9XJNDE3-Kz8Vz5C4hu7UZU9-dLcdNvHGNma-2ZrgZ_BK-9VNICseKjoeXmiFPmRH8MNBMa_-WjWv-iCJzdGCPmtouVpcN-84 Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: b067e3c448e24f179830992fecf65399 Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:00:12.953866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:00:12.955536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b067e3c448e24f179830992fecf65399"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b067e3c448e24f179830992fecf65399"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b067e3c448e24f179830992fecf65399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b067e3c448e24f179830992fecf65399"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:00:12.955536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 14:00:12.955536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: b067e3c448e24f179830992fecf65399 Jun 02 14:00:12.955536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 14:00:12.955536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-ServerRescueNegativeTestJSON-1754502689-project Jun 02 14:00:12.955536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:00:12.955536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:00:12.955536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: f9e57606c14a4ad99612414c1f9719f4 Jun 02 14:00:12.955536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1754502689-project Jun 02 14:00:12.955536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:00:12.955536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Cannot 'detach_volume' instance c714d190-39b3-40b8-a7d0-da49a06fe5fa while it is in vm_state rescued Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'server_id': 'c714d190-39b3-40b8-a7d0-da49a06fe5fa', 'id': 'baa53ff6-3031-4592-9243-4bebe48b2efd'} Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c714d190-39b3-40b8-a7d0-da49a06fe5fa in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:00:12.956275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c714d190-39b3-40b8-a7d0-da49a06fe5fa while it is in vm_state rescued Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c714d190-39b3-40b8-a7d0-da49a06fe5fa while it is in vm_state rescued Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:00:12.957816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7140f6e4-c7b6-4002-a0b0-2569414952bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Returning 409 to user: Cannot 'detach_volume' instance c714d190-39b3-40b8-a7d0-da49a06fe5fa while it is in vm_state rescued {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:00:12.959779 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7140f6e4-c7b6-4002-a0b0-2569414952bd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments/baa53ff6-3031-4592-9243-4bebe48b2efd" status: 409 len: 152 microversion: 2.1 time: 0.138636 Jun 02 14:00:12.959779 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 325/624] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 2 14:00:12 2022] DELETE /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments/baa53ff6-3031-4592-9243-4bebe48b2efd => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 02 14:00:12.965362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-13c3bab0-ee91-4dfe-b92e-cc252294c29e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:00:12.965894 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-13c3bab0-ee91-4dfe-b92e-cc252294c29e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:12.972078 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-13c3bab0-ee91-4dfe-b92e-cc252294c29e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:12.972570 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-13c3bab0-ee91-4dfe-b92e-cc252294c29e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:12.973359 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-13c3bab0-ee91-4dfe-b92e-cc252294c29e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:12.973792 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-13c3bab0-ee91-4dfe-b92e-cc252294c29e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:13.167404 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-13c3bab0-ee91-4dfe-b92e-cc252294c29e tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "POST /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/action" status: 202 len: 0 microversion: 2.1 time: 0.205564 Jun 02 14:00:13.167980 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 300/625] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 2 14:00:12 2022] POST /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:00:13.176117 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-358c55e5-21be-4bdd-a2c0-86782a7a8f5d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:13.176761 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-358c55e5-21be-4bdd-a2c0-86782a7a8f5d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:13.183644 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-358c55e5-21be-4bdd-a2c0-86782a7a8f5d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:13.184089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-358c55e5-21be-4bdd-a2c0-86782a7a8f5d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:13.184880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-358c55e5-21be-4bdd-a2c0-86782a7a8f5d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:13.185393 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-358c55e5-21be-4bdd-a2c0-86782a7a8f5d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:13.313015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-358c55e5-21be-4bdd-a2c0-86782a7a8f5d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:13.321546 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-358c55e5-21be-4bdd-a2c0-86782a7a8f5d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1720 microversion: 2.1 time: 0.149241 Jun 02 14:00:13.322112 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 326/626] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:13 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:13.765312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-78c693bf-d0d7-4e6b-8fe6-5997b8cc0b3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:13.765934 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-78c693bf-d0d7-4e6b-8fe6-5997b8cc0b3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:13.772082 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-78c693bf-d0d7-4e6b-8fe6-5997b8cc0b3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:13.772570 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-78c693bf-d0d7-4e6b-8fe6-5997b8cc0b3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:13.773327 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-78c693bf-d0d7-4e6b-8fe6-5997b8cc0b3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:13.773762 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-78c693bf-d0d7-4e6b-8fe6-5997b8cc0b3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:13.909180 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-78c693bf-d0d7-4e6b-8fe6-5997b8cc0b3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:13.917365 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-78c693bf-d0d7-4e6b-8fe6-5997b8cc0b3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1367 microversion: 2.1 time: 0.156814 Jun 02 14:00:13.918142 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 301/627] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:13 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:14.343800 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-35c9286d-a457-4893-be04-ca0dbcae8451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:14.344502 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-35c9286d-a457-4893-be04-ca0dbcae8451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:14.351928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-35c9286d-a457-4893-be04-ca0dbcae8451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:14.352377 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-35c9286d-a457-4893-be04-ca0dbcae8451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:14.356344 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-35c9286d-a457-4893-be04-ca0dbcae8451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:14.356344 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-35c9286d-a457-4893-be04-ca0dbcae8451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:14.490853 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-35c9286d-a457-4893-be04-ca0dbcae8451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:14.498993 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-35c9286d-a457-4893-be04-ca0dbcae8451 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1720 microversion: 2.1 time: 0.162002 Jun 02 14:00:14.500206 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 327/628] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:14 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:14.935296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e2f13d2e-1233-42f9-930d-64454c1c628f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:14.936045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e2f13d2e-1233-42f9-930d-64454c1c628f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:14.952252 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e2f13d2e-1233-42f9-930d-64454c1c628f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:14.952252 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e2f13d2e-1233-42f9-930d-64454c1c628f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:14.952252 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e2f13d2e-1233-42f9-930d-64454c1c628f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:14.952252 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e2f13d2e-1233-42f9-930d-64454c1c628f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:15.074177 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e2f13d2e-1233-42f9-930d-64454c1c628f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:15.081574 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e2f13d2e-1233-42f9-930d-64454c1c628f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1367 microversion: 2.1 time: 0.150201 Jun 02 14:00:15.082136 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 302/629] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:14 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:15.516455 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e9ac0d63-5dce-44d5-b3ce-125898041cee tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:15.517102 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e9ac0d63-5dce-44d5-b3ce-125898041cee tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:15.524012 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e9ac0d63-5dce-44d5-b3ce-125898041cee tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:15.524487 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e9ac0d63-5dce-44d5-b3ce-125898041cee tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:15.525246 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e9ac0d63-5dce-44d5-b3ce-125898041cee tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:15.525679 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e9ac0d63-5dce-44d5-b3ce-125898041cee tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:15.656748 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e9ac0d63-5dce-44d5-b3ce-125898041cee tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:15.665144 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e9ac0d63-5dce-44d5-b3ce-125898041cee tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1720 microversion: 2.1 time: 0.152545 Jun 02 14:00:15.665706 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 328/630] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:15 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:16.101139 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-217bd29b-5667-45fb-b16c-0720ace38473 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:16.101729 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-217bd29b-5667-45fb-b16c-0720ace38473 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:16.107989 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-217bd29b-5667-45fb-b16c-0720ace38473 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:16.108457 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-217bd29b-5667-45fb-b16c-0720ace38473 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:16.109282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-217bd29b-5667-45fb-b16c-0720ace38473 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:16.109718 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-217bd29b-5667-45fb-b16c-0720ace38473 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:16.244057 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-217bd29b-5667-45fb-b16c-0720ace38473 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:16.251737 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-217bd29b-5667-45fb-b16c-0720ace38473 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1557 microversion: 2.1 time: 0.156213 Jun 02 14:00:16.252300 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 303/631] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:16 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:16.268355 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-93abe664-3522-439e-a9ee-bce460b31b09 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:16.272667 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-93abe664-3522-439e-a9ee-bce460b31b09 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:16.275466 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-93abe664-3522-439e-a9ee-bce460b31b09 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:16.275912 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-93abe664-3522-439e-a9ee-bce460b31b09 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:16.276687 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-93abe664-3522-439e-a9ee-bce460b31b09 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:16.277121 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-93abe664-3522-439e-a9ee-bce460b31b09 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:16.353245 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-93abe664-3522-439e-a9ee-bce460b31b09 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088640 Jun 02 14:00:16.353870 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 329/632] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 2 14:00:16 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:00:16.681676 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b5c40028-814e-4f9b-a88d-2e6c707ec25a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:16.682289 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b5c40028-814e-4f9b-a88d-2e6c707ec25a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:16.688419 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b5c40028-814e-4f9b-a88d-2e6c707ec25a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:16.688892 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b5c40028-814e-4f9b-a88d-2e6c707ec25a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:16.689794 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b5c40028-814e-4f9b-a88d-2e6c707ec25a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:16.690092 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b5c40028-814e-4f9b-a88d-2e6c707ec25a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:16.901391 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b5c40028-814e-4f9b-a88d-2e6c707ec25a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:16.909522 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b5c40028-814e-4f9b-a88d-2e6c707ec25a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1720 microversion: 2.1 time: 0.231792 Jun 02 14:00:16.910091 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 304/633] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:16 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1720 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:17.408352 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-fa1fdc43-4b0d-499b-b587-c902ca2a137c req-d76e14fa-7eea-4408-a164-b979d5bfd9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6d1d51b-029d-43f1-ba8b-15f5ce6211e2", "tag": "fd0e9007-c941-4e85-8d7d-de310b3e3208"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:00:17.416653 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-fa1fdc43-4b0d-499b-b587-c902ca2a137c req-d76e14fa-7eea-4408-a164-b979d5bfd9e8 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:17.417169 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-fa1fdc43-4b0d-499b-b587-c902ca2a137c req-d76e14fa-7eea-4408-a164-b979d5bfd9e8 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:17.428687 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-fa1fdc43-4b0d-499b-b587-c902ca2a137c req-d76e14fa-7eea-4408-a164-b979d5bfd9e8 service nova] Creating event network-changed:fd0e9007-c941-4e85-8d7d-de310b3e3208 for instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 on hv-cinder-82651 Jun 02 14:00:17.433834 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-fa1fdc43-4b0d-499b-b587-c902ca2a137c req-d76e14fa-7eea-4408-a164-b979d5bfd9e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029626 Jun 02 14:00:17.434426 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 330/634] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:00:17.926853 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-85466311-a7e1-4185-9e25-796a1e8204ac tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:17.928008 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-85466311-a7e1-4185-9e25-796a1e8204ac tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:17.934719 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-85466311-a7e1-4185-9e25-796a1e8204ac tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:17.935104 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-85466311-a7e1-4185-9e25-796a1e8204ac tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:17.935868 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-85466311-a7e1-4185-9e25-796a1e8204ac tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:17.936304 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-85466311-a7e1-4185-9e25-796a1e8204ac tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:18.072798 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-85466311-a7e1-4185-9e25-796a1e8204ac tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:18.081278 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-85466311-a7e1-4185-9e25-796a1e8204ac tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1720 microversion: 2.1 time: 0.158413 Jun 02 14:00:18.081854 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 305/635] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:17 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:19.100663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-bd9c6ee5-79fc-4456-a19c-fc5b754a3343 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:19.101277 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-bd9c6ee5-79fc-4456-a19c-fc5b754a3343 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:19.107491 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bd9c6ee5-79fc-4456-a19c-fc5b754a3343 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:19.107938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bd9c6ee5-79fc-4456-a19c-fc5b754a3343 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:19.108725 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bd9c6ee5-79fc-4456-a19c-fc5b754a3343 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:19.109168 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bd9c6ee5-79fc-4456-a19c-fc5b754a3343 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:19.241933 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-bd9c6ee5-79fc-4456-a19c-fc5b754a3343 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:00:19.251581 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-bd9c6ee5-79fc-4456-a19c-fc5b754a3343 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1726 microversion: 2.1 time: 0.156149 Jun 02 14:00:19.252167 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 331/636] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:00:19 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:00:19.268330 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d4d60dae-dc43-42f0-9714-06a67aa006f1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:00:19.268891 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d4d60dae-dc43-42f0-9714-06a67aa006f1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:00:19.277177 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d4d60dae-dc43-42f0-9714-06a67aa006f1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:19.277632 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d4d60dae-dc43-42f0-9714-06a67aa006f1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:19.278416 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d4d60dae-dc43-42f0-9714-06a67aa006f1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:19.278849 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d4d60dae-dc43-42f0-9714-06a67aa006f1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:19.368026 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d4d60dae-dc43-42f0-9714-06a67aa006f1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103633 Jun 02 14:00:19.368877 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 306/637] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 2 14:00:19 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:00:20.511008 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-b10a7089-293d-44b7-b08e-c289899e3a63 req-9658b46c-6c5f-4ec5-9576-b8465cb1c31b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c714d190-39b3-40b8-a7d0-da49a06fe5fa", "tag": "49169967-d46d-4a7e-b861-a60a2de510d4"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:00:20.519692 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-b10a7089-293d-44b7-b08e-c289899e3a63 req-9658b46c-6c5f-4ec5-9576-b8465cb1c31b service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:20.520161 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-b10a7089-293d-44b7-b08e-c289899e3a63 req-9658b46c-6c5f-4ec5-9576-b8465cb1c31b service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:20.533992 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-b10a7089-293d-44b7-b08e-c289899e3a63 req-9658b46c-6c5f-4ec5-9576-b8465cb1c31b service nova] Creating event network-changed:49169967-d46d-4a7e-b861-a60a2de510d4 for instance c714d190-39b3-40b8-a7d0-da49a06fe5fa on hv-cinder-82651 Jun 02 14:00:20.539142 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-b10a7089-293d-44b7-b08e-c289899e3a63 req-9658b46c-6c5f-4ec5-9576-b8465cb1c31b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032574 Jun 02 14:00:20.539982 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 332/638] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:00:22.554527 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-93a85ef3-be4a-4c7d-8f37-e71ac6e115b6 req-e84efabd-99e2-44d4-83b9-047767dd70b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c714d190-39b3-40b8-a7d0-da49a06fe5fa", "tag": "49169967-d46d-4a7e-b861-a60a2de510d4"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:00:22.562639 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-93a85ef3-be4a-4c7d-8f37-e71ac6e115b6 req-e84efabd-99e2-44d4-83b9-047767dd70b4 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:00:22.563073 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-93a85ef3-be4a-4c7d-8f37-e71ac6e115b6 req-e84efabd-99e2-44d4-83b9-047767dd70b4 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:00:22.574232 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-93a85ef3-be4a-4c7d-8f37-e71ac6e115b6 req-e84efabd-99e2-44d4-83b9-047767dd70b4 service nova] Creating event network-changed:49169967-d46d-4a7e-b861-a60a2de510d4 for instance c714d190-39b3-40b8-a7d0-da49a06fe5fa on hv-cinder-82651 Jun 02 14:00:22.579506 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-93a85ef3-be4a-4c7d-8f37-e71ac6e115b6 req-e84efabd-99e2-44d4-83b9-047767dd70b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029322 Jun 02 14:00:22.582756 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 307/639] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:00:41.877781 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:00:41.878450 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Thu Jun 2 14:00:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:01:11.810624 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=21 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:11.811374 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=37 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:11.815610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-04922ca1-cf56-46a6-a085-21a49a3f5153 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:01:11.816667 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-04922ca1-cf56-46a6-a085-21a49a3f5153 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:11.822636 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-04922ca1-cf56-46a6-a085-21a49a3f5153 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:11.823083 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-04922ca1-cf56-46a6-a085-21a49a3f5153 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:11.824110 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-04922ca1-cf56-46a6-a085-21a49a3f5153 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:11.824573 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-04922ca1-cf56-46a6-a085-21a49a3f5153 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:12.021597 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-04922ca1-cf56-46a6-a085-21a49a3f5153 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "POST /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/action" status: 202 len: 0 microversion: 2.1 time: 0.212584 Jun 02 14:01:12.022246 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 333/640] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 2 14:01:11 2022] POST /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:01:12.028078 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:12.030686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:12.035105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-424a3849-3e87-443c-8f32-baf96d75c8ab tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:12.039553 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-424a3849-3e87-443c-8f32-baf96d75c8ab tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:12.042034 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-424a3849-3e87-443c-8f32-baf96d75c8ab tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:12.042486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-424a3849-3e87-443c-8f32-baf96d75c8ab tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:12.043245 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-424a3849-3e87-443c-8f32-baf96d75c8ab tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:12.043677 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-424a3849-3e87-443c-8f32-baf96d75c8ab tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:12.192670 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-424a3849-3e87-443c-8f32-baf96d75c8ab tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:12.200847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-424a3849-3e87-443c-8f32-baf96d75c8ab tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1752 microversion: 2.1 time: 0.174349 Jun 02 14:01:12.202089 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 308/641] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:12 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:13.220115 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0a96fb7a-a04f-4680-abd2-d19608c1014b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:13.220848 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0a96fb7a-a04f-4680-abd2-d19608c1014b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:13.227340 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0a96fb7a-a04f-4680-abd2-d19608c1014b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:13.227787 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0a96fb7a-a04f-4680-abd2-d19608c1014b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:13.228627 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0a96fb7a-a04f-4680-abd2-d19608c1014b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:13.229062 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0a96fb7a-a04f-4680-abd2-d19608c1014b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:13.370509 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0a96fb7a-a04f-4680-abd2-d19608c1014b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:13.379077 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0a96fb7a-a04f-4680-abd2-d19608c1014b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1757 microversion: 2.1 time: 0.163867 Jun 02 14:01:13.379652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 334/642] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:13 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:14.397710 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5091e1ad-c025-41b1-b69b-046f86214358 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:14.398305 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5091e1ad-c025-41b1-b69b-046f86214358 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:14.405466 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5091e1ad-c025-41b1-b69b-046f86214358 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:14.405905 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5091e1ad-c025-41b1-b69b-046f86214358 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:14.406659 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5091e1ad-c025-41b1-b69b-046f86214358 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:14.407108 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5091e1ad-c025-41b1-b69b-046f86214358 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:14.552603 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5091e1ad-c025-41b1-b69b-046f86214358 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:14.560387 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5091e1ad-c025-41b1-b69b-046f86214358 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1757 microversion: 2.1 time: 0.167012 Jun 02 14:01:14.561656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 309/643] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:14 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:15.578880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-92c62ea6-d3eb-49fe-939b-08fbca5b401b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:15.579520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-92c62ea6-d3eb-49fe-939b-08fbca5b401b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:15.585928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-92c62ea6-d3eb-49fe-939b-08fbca5b401b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:15.586356 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-92c62ea6-d3eb-49fe-939b-08fbca5b401b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:15.587103 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-92c62ea6-d3eb-49fe-939b-08fbca5b401b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:15.587530 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-92c62ea6-d3eb-49fe-939b-08fbca5b401b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:15.728196 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-92c62ea6-d3eb-49fe-939b-08fbca5b401b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:15.736253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-92c62ea6-d3eb-49fe-939b-08fbca5b401b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1757 microversion: 2.1 time: 0.161927 Jun 02 14:01:15.736844 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 335/644] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:15 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:16.753323 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-21818725-e0fa-4d67-b55e-d25b9c34e7c5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:16.753876 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-21818725-e0fa-4d67-b55e-d25b9c34e7c5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:16.760373 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-21818725-e0fa-4d67-b55e-d25b9c34e7c5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:16.760857 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-21818725-e0fa-4d67-b55e-d25b9c34e7c5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:16.761615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-21818725-e0fa-4d67-b55e-d25b9c34e7c5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:16.762050 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-21818725-e0fa-4d67-b55e-d25b9c34e7c5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:16.903098 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-21818725-e0fa-4d67-b55e-d25b9c34e7c5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:16.912239 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-21818725-e0fa-4d67-b55e-d25b9c34e7c5 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1757 microversion: 2.1 time: 0.162841 Jun 02 14:01:16.912825 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 310/645] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:16 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:17.930091 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-71b39824-9df0-4ac3-9602-63f86fd922fd tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:17.930641 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-71b39824-9df0-4ac3-9602-63f86fd922fd tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:17.937494 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-71b39824-9df0-4ac3-9602-63f86fd922fd tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:17.937978 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-71b39824-9df0-4ac3-9602-63f86fd922fd tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:17.938736 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-71b39824-9df0-4ac3-9602-63f86fd922fd tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:17.939171 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-71b39824-9df0-4ac3-9602-63f86fd922fd tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:18.082442 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-71b39824-9df0-4ac3-9602-63f86fd922fd tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:18.090268 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-71b39824-9df0-4ac3-9602-63f86fd922fd tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1757 microversion: 2.1 time: 0.164213 Jun 02 14:01:18.090820 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 336/646] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:17 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:19.109021 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-951e2fb3-eb2d-46e4-b669-32f76202c9d8 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:19.109641 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-951e2fb3-eb2d-46e4-b669-32f76202c9d8 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:19.116202 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-951e2fb3-eb2d-46e4-b669-32f76202c9d8 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:19.116682 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-951e2fb3-eb2d-46e4-b669-32f76202c9d8 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:19.117446 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-951e2fb3-eb2d-46e4-b669-32f76202c9d8 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:19.117878 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-951e2fb3-eb2d-46e4-b669-32f76202c9d8 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:19.259476 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-951e2fb3-eb2d-46e4-b669-32f76202c9d8 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:19.267448 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-951e2fb3-eb2d-46e4-b669-32f76202c9d8 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1757 microversion: 2.1 time: 0.162936 Jun 02 14:01:19.268016 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 311/647] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:19 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:20.284105 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6de21317-14bc-4cc6-9d1c-14b476166455 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:20.284756 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6de21317-14bc-4cc6-9d1c-14b476166455 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:20.291184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6de21317-14bc-4cc6-9d1c-14b476166455 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:20.291617 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6de21317-14bc-4cc6-9d1c-14b476166455 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:20.292358 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6de21317-14bc-4cc6-9d1c-14b476166455 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:20.292832 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6de21317-14bc-4cc6-9d1c-14b476166455 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:20.439314 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6de21317-14bc-4cc6-9d1c-14b476166455 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:20.447221 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6de21317-14bc-4cc6-9d1c-14b476166455 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1757 microversion: 2.1 time: 0.167038 Jun 02 14:01:20.447786 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 337/648] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:20 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:21.021970 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c6a93019-84b0-4320-87a4-0220042e67fe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:21.022497 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c6a93019-84b0-4320-87a4-0220042e67fe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:21.028936 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c6a93019-84b0-4320-87a4-0220042e67fe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:21.029383 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c6a93019-84b0-4320-87a4-0220042e67fe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:21.030393 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c6a93019-84b0-4320-87a4-0220042e67fe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:21.030864 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c6a93019-84b0-4320-87a4-0220042e67fe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:21.063063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c6a93019-84b0-4320-87a4-0220042e67fe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments/7c062707-50cc-4a34-a390-48f5b8a18621" status: 200 len: 194 microversion: 2.20 time: 0.045664 Jun 02 14:01:21.063638 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 312/649] 10.222.0.33 () {60 vars in 1453 bytes} [Thu Jun 2 14:01:21 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments/7c062707-50cc-4a34-a390-48f5b8a18621 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 14:01:21.106554 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6a3c1c55-7e7b-4917-b8f3-d0026251a20a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:21.107044 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6a3c1c55-7e7b-4917-b8f3-d0026251a20a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:21.113701 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6a3c1c55-7e7b-4917-b8f3-d0026251a20a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:21.114147 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6a3c1c55-7e7b-4917-b8f3-d0026251a20a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:21.114901 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6a3c1c55-7e7b-4917-b8f3-d0026251a20a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:21.115333 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6a3c1c55-7e7b-4917-b8f3-d0026251a20a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:21.129541 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-6dc2d12c-4df8-4746-b8a9-8a53c7f13564 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:21.130039 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-6dc2d12c-4df8-4746-b8a9-8a53c7f13564 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:21.135967 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6dc2d12c-4df8-4746-b8a9-8a53c7f13564 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:21.136435 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6dc2d12c-4df8-4746-b8a9-8a53c7f13564 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:21.137201 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6dc2d12c-4df8-4746-b8a9-8a53c7f13564 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:21.137632 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6dc2d12c-4df8-4746-b8a9-8a53c7f13564 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:21.140746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6a3c1c55-7e7b-4917-b8f3-d0026251a20a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Going to try to terminate instance {{(pid=118316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:01:21.259055 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-6dc2d12c-4df8-4746-b8a9-8a53c7f13564 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lazy-loading 'services' on Instance uuid 83d462ae-af14-4d5d-aab2-f45954429480 {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:01:21.480247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6a3c1c55-7e7b-4917-b8f3-d0026251a20a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 204 len: 0 microversion: 2.1 time: 0.377441 Jun 02 14:01:21.481008 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 338/650] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:01:21 2022] DELETE /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:01:21.486474 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-84615bb2-5733-49f1-a68f-1b80dfc8efd3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:21.489636 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-84615bb2-5733-49f1-a68f-1b80dfc8efd3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:21.493222 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84615bb2-5733-49f1-a68f-1b80dfc8efd3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:21.493667 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84615bb2-5733-49f1-a68f-1b80dfc8efd3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:21.494451 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84615bb2-5733-49f1-a68f-1b80dfc8efd3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:21.494940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84615bb2-5733-49f1-a68f-1b80dfc8efd3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:21.543333 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-6dc2d12c-4df8-4746-b8a9-8a53c7f13564 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments/7c062707-50cc-4a34-a390-48f5b8a18621" status: 202 len: 0 microversion: 2.20 time: 0.417474 Jun 02 14:01:21.543932 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 313/651] 10.222.0.33 () {60 vars in 1456 bytes} [Thu Jun 2 14:01:21 2022] DELETE /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments/7c062707-50cc-4a34-a390-48f5b8a18621 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 02 14:01:21.549575 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4bc84156-35a7-422f-898a-225ac651ccc1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:21.550273 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4bc84156-35a7-422f-898a-225ac651ccc1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:21.556584 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4bc84156-35a7-422f-898a-225ac651ccc1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:21.557097 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4bc84156-35a7-422f-898a-225ac651ccc1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:21.557874 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4bc84156-35a7-422f-898a-225ac651ccc1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:21.558314 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4bc84156-35a7-422f-898a-225ac651ccc1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:21.685405 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-84615bb2-5733-49f1-a68f-1b80dfc8efd3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:21.694246 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-84615bb2-5733-49f1-a68f-1b80dfc8efd3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1757 microversion: 2.1 time: 0.212089 Jun 02 14:01:21.694832 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 339/652] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:21 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1757 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:21.699934 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a7682d79-37ca-49fc-b32a-3ef509a47ad7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:21.701838 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a7682d79-37ca-49fc-b32a-3ef509a47ad7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:21.708017 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a7682d79-37ca-49fc-b32a-3ef509a47ad7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:21.708496 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a7682d79-37ca-49fc-b32a-3ef509a47ad7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:21.709328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a7682d79-37ca-49fc-b32a-3ef509a47ad7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:21.709789 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a7682d79-37ca-49fc-b32a-3ef509a47ad7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:21.728955 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4bc84156-35a7-422f-898a-225ac651ccc1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:21.737878 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4bc84156-35a7-422f-898a-225ac651ccc1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1576 microversion: 2.1 time: 0.192678 Jun 02 14:01:21.738541 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 314/653] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:21 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:21.738992 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a7682d79-37ca-49fc-b32a-3ef509a47ad7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043125 Jun 02 14:01:21.739547 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 340/654] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 2 14:01:21 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 14:01:22.712564 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-36ec02de-6022-480a-b0c6-6496a5bba498 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:22.713197 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-36ec02de-6022-480a-b0c6-6496a5bba498 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:22.720291 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-36ec02de-6022-480a-b0c6-6496a5bba498 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:22.726562 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-36ec02de-6022-480a-b0c6-6496a5bba498 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:22.726562 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-36ec02de-6022-480a-b0c6-6496a5bba498 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:22.726562 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-36ec02de-6022-480a-b0c6-6496a5bba498 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:22.755904 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ab167ebb-d639-485d-a3b3-d87393e62889 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:22.755904 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ab167ebb-d639-485d-a3b3-d87393e62889 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:22.758170 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ab167ebb-d639-485d-a3b3-d87393e62889 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:22.758620 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ab167ebb-d639-485d-a3b3-d87393e62889 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:22.759383 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ab167ebb-d639-485d-a3b3-d87393e62889 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:22.759814 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ab167ebb-d639-485d-a3b3-d87393e62889 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:22.797201 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ab167ebb-d639-485d-a3b3-d87393e62889 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050204 Jun 02 14:01:22.798279 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 341/655] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 2 14:01:22 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 14:01:22.804096 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5cc35469-91b1-4853-a431-3ef30d991c1d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:22.804804 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-5cc35469-91b1-4853-a431-3ef30d991c1d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:22.810831 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5cc35469-91b1-4853-a431-3ef30d991c1d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:22.811428 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5cc35469-91b1-4853-a431-3ef30d991c1d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:22.812613 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5cc35469-91b1-4853-a431-3ef30d991c1d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:22.813053 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5cc35469-91b1-4853-a431-3ef30d991c1d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:22.953728 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-36ec02de-6022-480a-b0c6-6496a5bba498 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:22.962375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-36ec02de-6022-480a-b0c6-6496a5bba498 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1757 microversion: 2.1 time: 0.253641 Jun 02 14:01:22.963258 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 315/656] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:22 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1757 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:22.997847 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5cc35469-91b1-4853-a431-3ef30d991c1d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:23.006935 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5cc35469-91b1-4853-a431-3ef30d991c1d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1576 microversion: 2.1 time: 0.207519 Jun 02 14:01:23.007816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 342/657] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:22 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:23.809472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5a7abc82-71c8-4262-bf27-654453ea6be4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:23.810384 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5a7abc82-71c8-4262-bf27-654453ea6be4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:23.817554 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5a7abc82-71c8-4262-bf27-654453ea6be4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:23.818004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5a7abc82-71c8-4262-bf27-654453ea6be4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:23.818765 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5a7abc82-71c8-4262-bf27-654453ea6be4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:23.819196 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5a7abc82-71c8-4262-bf27-654453ea6be4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:23.848253 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5a7abc82-71c8-4262-bf27-654453ea6be4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042948 Jun 02 14:01:23.848837 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 316/658] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 2 14:01:23 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 14:01:23.982132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5bfde298-d76c-4188-9fb5-820c308652fb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:23.983044 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-5bfde298-d76c-4188-9fb5-820c308652fb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:23.990545 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5bfde298-d76c-4188-9fb5-820c308652fb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:23.991179 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5bfde298-d76c-4188-9fb5-820c308652fb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:23.992312 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5bfde298-d76c-4188-9fb5-820c308652fb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:23.992921 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5bfde298-d76c-4188-9fb5-820c308652fb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:24.023940 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4fe1d0ed-445f-4ae9-80ed-b7154e805701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:24.024685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4fe1d0ed-445f-4ae9-80ed-b7154e805701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:24.030967 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4fe1d0ed-445f-4ae9-80ed-b7154e805701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:24.031416 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4fe1d0ed-445f-4ae9-80ed-b7154e805701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:24.032191 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4fe1d0ed-445f-4ae9-80ed-b7154e805701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:24.032655 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4fe1d0ed-445f-4ae9-80ed-b7154e805701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:24.204800 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5bfde298-d76c-4188-9fb5-820c308652fb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:24.212929 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5bfde298-d76c-4188-9fb5-820c308652fb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1757 microversion: 2.1 time: 0.235123 Jun 02 14:01:24.213702 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 343/659] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:23 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1757 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:24.226512 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4fe1d0ed-445f-4ae9-80ed-b7154e805701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:24.234692 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4fe1d0ed-445f-4ae9-80ed-b7154e805701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1576 microversion: 2.1 time: 0.214460 Jun 02 14:01:24.235254 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 317/660] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:24 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:24.410642 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-04bec765-096d-4c7a-94a0-125ee182f5d1 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:01:24.411195 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-04bec765-096d-4c7a-94a0-125ee182f5d1 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:24.417292 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-04bec765-096d-4c7a-94a0-125ee182f5d1 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:24.417762 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-04bec765-096d-4c7a-94a0-125ee182f5d1 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:24.418435 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-04bec765-096d-4c7a-94a0-125ee182f5d1 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:24.418866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-04bec765-096d-4c7a-94a0-125ee182f5d1 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:24.443282 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-04bec765-096d-4c7a-94a0-125ee182f5d1 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lazy-loading 'flavor' on Instance uuid 4253a95d-5443-4a20-9a10-621c058e8674 {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:01:24.764635 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:24.773215 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-04bec765-096d-4c7a-94a0-125ee182f5d1 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "POST /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674/action" status: 202 len: 0 microversion: 2.1 time: 0.366389 Jun 02 14:01:24.777066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 344/661] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 2 14:01:24 2022] POST /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:01:24.782561 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0847aaf9-5c8e-4a02-9ba3-fc8057b6b013 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:24.783202 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0847aaf9-5c8e-4a02-9ba3-fc8057b6b013 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:24.789626 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0847aaf9-5c8e-4a02-9ba3-fc8057b6b013 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:24.790072 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0847aaf9-5c8e-4a02-9ba3-fc8057b6b013 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:24.790856 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0847aaf9-5c8e-4a02-9ba3-fc8057b6b013 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:24.791280 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0847aaf9-5c8e-4a02-9ba3-fc8057b6b013 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:24.861431 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-59a71e97-a723-40d7-adb4-c26cffd1f51d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:24.862775 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-59a71e97-a723-40d7-adb4-c26cffd1f51d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:24.869944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-59a71e97-a723-40d7-adb4-c26cffd1f51d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:24.870425 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-59a71e97-a723-40d7-adb4-c26cffd1f51d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:24.871258 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-59a71e97-a723-40d7-adb4-c26cffd1f51d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:24.871701 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-59a71e97-a723-40d7-adb4-c26cffd1f51d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:24.904651 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-59a71e97-a723-40d7-adb4-c26cffd1f51d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048348 Jun 02 14:01:24.905392 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 345/662] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 2 14:01:24 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 14:01:24.944384 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0847aaf9-5c8e-4a02-9ba3-fc8057b6b013 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:24.953067 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0847aaf9-5c8e-4a02-9ba3-fc8057b6b013 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.174856 Jun 02 14:01:24.956478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 318/663] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:24 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:25.232318 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-484e81ea-8252-4a12-9828-0bc3e417f524 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:25.233078 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-484e81ea-8252-4a12-9828-0bc3e417f524 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:25.239811 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-484e81ea-8252-4a12-9828-0bc3e417f524 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:25.240427 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-484e81ea-8252-4a12-9828-0bc3e417f524 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:25.241231 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-484e81ea-8252-4a12-9828-0bc3e417f524 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:25.241660 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-484e81ea-8252-4a12-9828-0bc3e417f524 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:25.251825 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2dccff1b-25be-415d-84e2-277191ae7b16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:25.252738 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-2dccff1b-25be-415d-84e2-277191ae7b16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:25.268728 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2dccff1b-25be-415d-84e2-277191ae7b16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:25.269239 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2dccff1b-25be-415d-84e2-277191ae7b16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:25.270194 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2dccff1b-25be-415d-84e2-277191ae7b16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:25.271053 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2dccff1b-25be-415d-84e2-277191ae7b16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:25.375300 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2dccff1b-25be-415d-84e2-277191ae7b16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:25.384443 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2dccff1b-25be-415d-84e2-277191ae7b16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1509 microversion: 2.1 time: 0.137112 Jun 02 14:01:25.385397 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 319/664] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:25 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1509 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:25.391494 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-cfbe9f41-e63c-4418-9764-13c5e8188c26 req-b5873f6f-94e2-42f5-b0c1-f0fcd0f919e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff8b777-591b-48fc-8e08-8722d8a3adca", "name": "network-vif-deleted", "tag": "5161504c-7de3-4d83-8150-813b7b219462"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:01:25.401085 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-cfbe9f41-e63c-4418-9764-13c5e8188c26 req-b5873f6f-94e2-42f5-b0c1-f0fcd0f919e9 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:25.401532 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-cfbe9f41-e63c-4418-9764-13c5e8188c26 req-b5873f6f-94e2-42f5-b0c1-f0fcd0f919e9 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:25.415265 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-cfbe9f41-e63c-4418-9764-13c5e8188c26 req-b5873f6f-94e2-42f5-b0c1-f0fcd0f919e9 service nova] Creating event network-vif-deleted:5161504c-7de3-4d83-8150-813b7b219462 for instance 6ff8b777-591b-48fc-8e08-8722d8a3adca on hv-cinder-82651 Jun 02 14:01:25.421464 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-cfbe9f41-e63c-4418-9764-13c5e8188c26 req-b5873f6f-94e2-42f5-b0c1-f0fcd0f919e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034105 Jun 02 14:01:25.425474 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 320/665] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:01:25.464021 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-484e81ea-8252-4a12-9828-0bc3e417f524 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:25.473180 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-484e81ea-8252-4a12-9828-0bc3e417f524 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1757 microversion: 2.1 time: 0.245999 Jun 02 14:01:25.483092 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 346/666] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:25 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1757 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:25.917694 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c91edc0f-72e2-4d70-95c6-9d7caa31ed41 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:25.918780 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c91edc0f-72e2-4d70-95c6-9d7caa31ed41 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:25.925339 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c91edc0f-72e2-4d70-95c6-9d7caa31ed41 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:25.925865 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c91edc0f-72e2-4d70-95c6-9d7caa31ed41 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:25.926696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c91edc0f-72e2-4d70-95c6-9d7caa31ed41 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:25.927225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c91edc0f-72e2-4d70-95c6-9d7caa31ed41 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:25.958740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c91edc0f-72e2-4d70-95c6-9d7caa31ed41 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045879 Jun 02 14:01:25.959471 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 321/667] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 2 14:01:25 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:26.059431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-69042a16-e41d-4cce-bee0-3f7fb3fcea47 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:26.060235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-69042a16-e41d-4cce-bee0-3f7fb3fcea47 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:26.069069 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-69042a16-e41d-4cce-bee0-3f7fb3fcea47 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:26.069785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-69042a16-e41d-4cce-bee0-3f7fb3fcea47 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:26.070779 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-69042a16-e41d-4cce-bee0-3f7fb3fcea47 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:26.072095 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-69042a16-e41d-4cce-bee0-3f7fb3fcea47 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:26.117545 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-69042a16-e41d-4cce-bee0-3f7fb3fcea47 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Going to try to terminate instance {{(pid=118315) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:01:26.118330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-1ab311d9-5ea2-4925-82ec-cb75c49262f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:26.119006 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-1ab311d9-5ea2-4925-82ec-cb75c49262f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:26.126108 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1ab311d9-5ea2-4925-82ec-cb75c49262f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:26.126788 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1ab311d9-5ea2-4925-82ec-cb75c49262f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:26.127641 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1ab311d9-5ea2-4925-82ec-cb75c49262f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:26.128162 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1ab311d9-5ea2-4925-82ec-cb75c49262f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:26.261692 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:26.291493 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1ab311d9-5ea2-4925-82ec-cb75c49262f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:26.304336 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-1ab311d9-5ea2-4925-82ec-cb75c49262f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.335349 Jun 02 14:01:26.308225 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 347/668] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:25 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:26.403489 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-212ecdcc-7b77-44ca-af24-4bcdb2c68a34 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:26.404171 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-212ecdcc-7b77-44ca-af24-4bcdb2c68a34 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:26.410970 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-212ecdcc-7b77-44ca-af24-4bcdb2c68a34 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:26.411443 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-212ecdcc-7b77-44ca-af24-4bcdb2c68a34 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:26.412208 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-212ecdcc-7b77-44ca-af24-4bcdb2c68a34 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:26.412667 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-212ecdcc-7b77-44ca-af24-4bcdb2c68a34 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:26.449894 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-212ecdcc-7b77-44ca-af24-4bcdb2c68a34 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:26.450686 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-212ecdcc-7b77-44ca-af24-4bcdb2c68a34 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:26.451351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-212ecdcc-7b77-44ca-af24-4bcdb2c68a34 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lazy-loading 'fault' on Instance uuid 6ff8b777-591b-48fc-8e08-8722d8a3adca {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:01:26.455120 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-69042a16-e41d-4cce-bee0-3f7fb3fcea47 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 204 len: 0 microversion: 2.20 time: 0.397668 Jun 02 14:01:26.460273 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 322/669] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 2 14:01:26 2022] DELETE /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 14:01:26.467473 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-029db458-89c8-496e-8c5a-48f50a966e37 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:26.468578 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-029db458-89c8-496e-8c5a-48f50a966e37 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:26.477121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-029db458-89c8-496e-8c5a-48f50a966e37 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:26.477633 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-029db458-89c8-496e-8c5a-48f50a966e37 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:26.478560 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-029db458-89c8-496e-8c5a-48f50a966e37 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:26.479055 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-029db458-89c8-496e-8c5a-48f50a966e37 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:26.506416 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-212ecdcc-7b77-44ca-af24-4bcdb2c68a34 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:26.516771 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-212ecdcc-7b77-44ca-af24-4bcdb2c68a34 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1230 microversion: 2.1 time: 0.117275 Jun 02 14:01:26.518310 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 348/670] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:26 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1230 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:26.523943 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ce25c963-fba2-41e7-93e2-8972ca03c117 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:26.524859 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ce25c963-fba2-41e7-93e2-8972ca03c117 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:26.533507 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ce25c963-fba2-41e7-93e2-8972ca03c117 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:26.533961 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ce25c963-fba2-41e7-93e2-8972ca03c117 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:26.535076 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ce25c963-fba2-41e7-93e2-8972ca03c117 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:26.535520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ce25c963-fba2-41e7-93e2-8972ca03c117 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:26.681914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-029db458-89c8-496e-8c5a-48f50a966e37 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:26.694737 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-029db458-89c8-496e-8c5a-48f50a966e37 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:26.696914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-029db458-89c8-496e-8c5a-48f50a966e37 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:26.698778 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-029db458-89c8-496e-8c5a-48f50a966e37 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.236068 Jun 02 14:01:26.699707 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 323/671] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:26 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:01:26.742470 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ce25c963-fba2-41e7-93e2-8972ca03c117 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:26.751622 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ce25c963-fba2-41e7-93e2-8972ca03c117 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1757 microversion: 2.1 time: 0.232088 Jun 02 14:01:26.752249 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 349/672] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:26 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1757 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:27.323465 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-27d275a4-11e8-42cb-87d4-4035abcd79b5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:27.324080 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-27d275a4-11e8-42cb-87d4-4035abcd79b5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:27.331150 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-27d275a4-11e8-42cb-87d4-4035abcd79b5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:27.331599 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-27d275a4-11e8-42cb-87d4-4035abcd79b5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:27.332360 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-27d275a4-11e8-42cb-87d4-4035abcd79b5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:27.332833 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-27d275a4-11e8-42cb-87d4-4035abcd79b5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:27.463324 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-27d275a4-11e8-42cb-87d4-4035abcd79b5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:27.471999 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-27d275a4-11e8-42cb-87d4-4035abcd79b5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.152730 Jun 02 14:01:27.472592 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 324/673] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:27 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:27.534456 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2f438453-04ff-4844-9e04-ac9057d9b31b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:27.535062 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2f438453-04ff-4844-9e04-ac9057d9b31b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:27.541742 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2f438453-04ff-4844-9e04-ac9057d9b31b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:27.542184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2f438453-04ff-4844-9e04-ac9057d9b31b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:27.542926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2f438453-04ff-4844-9e04-ac9057d9b31b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:27.543360 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2f438453-04ff-4844-9e04-ac9057d9b31b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:27.574415 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2f438453-04ff-4844-9e04-ac9057d9b31b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:27.574774 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2f438453-04ff-4844-9e04-ac9057d9b31b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:27.575208 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-2f438453-04ff-4844-9e04-ac9057d9b31b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lazy-loading 'fault' on Instance uuid 6ff8b777-591b-48fc-8e08-8722d8a3adca {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:01:27.620431 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2f438453-04ff-4844-9e04-ac9057d9b31b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:27.629135 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2f438453-04ff-4844-9e04-ac9057d9b31b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1230 microversion: 2.1 time: 0.098375 Jun 02 14:01:27.629795 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 350/674] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:27 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:27.721559 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-96f91069-c09c-4b89-bb30-d01be4b7bf45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:27.722180 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-96f91069-c09c-4b89-bb30-d01be4b7bf45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:27.728497 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-96f91069-c09c-4b89-bb30-d01be4b7bf45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:27.728946 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-96f91069-c09c-4b89-bb30-d01be4b7bf45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:27.729727 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-96f91069-c09c-4b89-bb30-d01be4b7bf45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:27.730164 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-96f91069-c09c-4b89-bb30-d01be4b7bf45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:27.769338 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-161fe4ca-aba0-47b2-a067-181fd6e9e57d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:27.769949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-161fe4ca-aba0-47b2-a067-181fd6e9e57d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:27.776278 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-161fe4ca-aba0-47b2-a067-181fd6e9e57d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:27.776746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-161fe4ca-aba0-47b2-a067-181fd6e9e57d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:27.777511 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-161fe4ca-aba0-47b2-a067-181fd6e9e57d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:27.777933 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-161fe4ca-aba0-47b2-a067-181fd6e9e57d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:27.924035 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-96f91069-c09c-4b89-bb30-d01be4b7bf45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:27.933314 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-96f91069-c09c-4b89-bb30-d01be4b7bf45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:27.934966 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-96f91069-c09c-4b89-bb30-d01be4b7bf45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:27.936141 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-96f91069-c09c-4b89-bb30-d01be4b7bf45 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.218976 Jun 02 14:01:27.938008 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 325/675] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:27 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:27.965240 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-161fe4ca-aba0-47b2-a067-181fd6e9e57d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:27.973386 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-161fe4ca-aba0-47b2-a067-181fd6e9e57d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1757 microversion: 2.1 time: 0.207902 Jun 02 14:01:27.973955 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 351/676] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:27 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1757 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:28.489977 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4946054d-ba77-4f65-a750-8eeb259a5f98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:28.491144 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4946054d-ba77-4f65-a750-8eeb259a5f98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:28.497428 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4946054d-ba77-4f65-a750-8eeb259a5f98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:28.497878 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4946054d-ba77-4f65-a750-8eeb259a5f98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:28.498689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4946054d-ba77-4f65-a750-8eeb259a5f98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:28.499228 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4946054d-ba77-4f65-a750-8eeb259a5f98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:28.641678 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4946054d-ba77-4f65-a750-8eeb259a5f98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:28.646212 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4d08690f-f683-4b70-9191-cb77e6c05c0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:28.646828 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4d08690f-f683-4b70-9191-cb77e6c05c0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:28.649342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4946054d-ba77-4f65-a750-8eeb259a5f98 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.163552 Jun 02 14:01:28.650114 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 326/677] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:28 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:28.653342 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4d08690f-f683-4b70-9191-cb77e6c05c0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:28.653792 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4d08690f-f683-4b70-9191-cb77e6c05c0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:28.654617 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4d08690f-f683-4b70-9191-cb77e6c05c0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:28.655677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4d08690f-f683-4b70-9191-cb77e6c05c0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:28.685677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4d08690f-f683-4b70-9191-cb77e6c05c0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:28.686185 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4d08690f-f683-4b70-9191-cb77e6c05c0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:28.686631 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-4d08690f-f683-4b70-9191-cb77e6c05c0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lazy-loading 'fault' on Instance uuid 6ff8b777-591b-48fc-8e08-8722d8a3adca {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:01:28.726769 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4d08690f-f683-4b70-9191-cb77e6c05c0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:28.734292 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4d08690f-f683-4b70-9191-cb77e6c05c0d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 200 len: 1230 microversion: 2.1 time: 0.091839 Jun 02 14:01:28.734854 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 352/678] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:28 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 1230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:28.955541 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3baaea85-6004-4b26-9cc7-93849a3848e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:28.956152 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3baaea85-6004-4b26-9cc7-93849a3848e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:28.962342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3baaea85-6004-4b26-9cc7-93849a3848e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:28.962788 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3baaea85-6004-4b26-9cc7-93849a3848e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:28.963544 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3baaea85-6004-4b26-9cc7-93849a3848e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:28.963978 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3baaea85-6004-4b26-9cc7-93849a3848e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:28.989621 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e4ec6cef-c27a-48a6-8ceb-0f503bfefa4b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:28.990241 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e4ec6cef-c27a-48a6-8ceb-0f503bfefa4b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:28.996147 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e4ec6cef-c27a-48a6-8ceb-0f503bfefa4b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:28.996631 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e4ec6cef-c27a-48a6-8ceb-0f503bfefa4b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:28.997394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e4ec6cef-c27a-48a6-8ceb-0f503bfefa4b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:28.997824 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e4ec6cef-c27a-48a6-8ceb-0f503bfefa4b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:29.147023 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3baaea85-6004-4b26-9cc7-93849a3848e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:29.156067 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3baaea85-6004-4b26-9cc7-93849a3848e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:29.157638 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3baaea85-6004-4b26-9cc7-93849a3848e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:29.158808 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3baaea85-6004-4b26-9cc7-93849a3848e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1723 microversion: 2.20 time: 0.207767 Jun 02 14:01:29.159366 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 327/679] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:28 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:29.183157 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e4ec6cef-c27a-48a6-8ceb-0f503bfefa4b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:29.191678 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e4ec6cef-c27a-48a6-8ceb-0f503bfefa4b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1757 microversion: 2.1 time: 0.205825 Jun 02 14:01:29.192254 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 353/680] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:28 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:29.666914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c00520b3-1ef3-4efd-8cd3-cc2cdbdd0d5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:29.667760 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c00520b3-1ef3-4efd-8cd3-cc2cdbdd0d5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:29.675036 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c00520b3-1ef3-4efd-8cd3-cc2cdbdd0d5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:29.682083 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c00520b3-1ef3-4efd-8cd3-cc2cdbdd0d5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:29.682083 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c00520b3-1ef3-4efd-8cd3-cc2cdbdd0d5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:29.682083 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c00520b3-1ef3-4efd-8cd3-cc2cdbdd0d5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:29.752981 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-efcfca9b-afe8-47e8-a67f-dc31d05db7af tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:29.754244 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-efcfca9b-afe8-47e8-a67f-dc31d05db7af tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:29.767146 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-efcfca9b-afe8-47e8-a67f-dc31d05db7af tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:29.767596 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-efcfca9b-afe8-47e8-a67f-dc31d05db7af tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:29.768367 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-efcfca9b-afe8-47e8-a67f-dc31d05db7af tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:29.768829 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-efcfca9b-afe8-47e8-a67f-dc31d05db7af tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:29.785421 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-efcfca9b-afe8-47e8-a67f-dc31d05db7af tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] HTTP exception thrown: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-efcfca9b-afe8-47e8-a67f-dc31d05db7af tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Request method failure captured: Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca HTTP/1.1 Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMF5gKYp9MMUFShZJvK8HWskj9c8oo7jw4xQHHv76ViSQZdjAaCopsHmNg9Z6OlkZCBQnmUJyI1SOwkTMxzwheYZ0C-B6ggUiF5fmge5TxytZPk01P0tct8Tp6fYqDzP4loJskleQvKj6QFPBiOoAalNEK-boGqHEgSQ0NKEALPF9pU Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: b55a34a53b2740d9af5efd660424a456 Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-TestVolumeBootPattern-587815091 Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:01:29.787337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:01:29.789026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b55a34a53b2740d9af5efd660424a456"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:01:29.789026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-TestVolumeBootPattern-587815091 Jun 02 14:01:29.789026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: b55a34a53b2740d9af5efd660424a456 Jun 02 14:01:29.789026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-TestVolumeBootPattern-587815091 Jun 02 14:01:29.789026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-TestVolumeBootPattern-587815091-project Jun 02 14:01:29.789026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:01:29.789026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:01:29.789026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 315c0d9d9a284389ae07bf898c330605 Jun 02 14:01:29.789026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-TestVolumeBootPattern-587815091-project Jun 02 14:01:29.789026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:01:29.789026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:01:29.789026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': '6ff8b777-591b-48fc-8e08-8722d8a3adca'} Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:01:29.789949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:01:29.791570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:01:29.793573 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-efcfca9b-afe8-47e8-a67f-dc31d05db7af tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Returning 404 to user: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:01:29.794563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-efcfca9b-afe8-47e8-a67f-dc31d05db7af tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 404 len: 111 microversion: 2.1 time: 0.046748 Jun 02 14:01:29.795486 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 354/681] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:29 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:01:29.822685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c00520b3-1ef3-4efd-8cd3-cc2cdbdd0d5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:29.831816 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c00520b3-1ef3-4efd-8cd3-cc2cdbdd0d5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.168720 Jun 02 14:01:29.834620 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 328/682] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:29 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:29.900004 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1203241603", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1891088145", "security_groups": [{"name": "tempest-secgroup-smoke-995264798"}], "block_device_mapping_v2": [{"uuid": "580c5bdb-e969-4779-b3b5-00c78d8a8ee0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "86c95916-f1de-4921-b403-dd7a25eabe5a"}]}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:01:30.027953 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.network.neutron [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] validate_networks() for [('86c95916-f1de-4921-b403-dd7a25eabe5a', None, None, None, None, None)] {{(pid=118316) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 14:01:30.176697 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d3dacdb3-e4f8-48d4-9e28-a26341c29477 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:30.177412 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d3dacdb3-e4f8-48d4-9e28-a26341c29477 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:30.184278 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3dacdb3-e4f8-48d4-9e28-a26341c29477 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:30.184781 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3dacdb3-e4f8-48d4-9e28-a26341c29477 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:30.185554 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3dacdb3-e4f8-48d4-9e28-a26341c29477 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:30.186111 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3dacdb3-e4f8-48d4-9e28-a26341c29477 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:30.261052 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d3dacdb3-e4f8-48d4-9e28-a26341c29477 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:30.270395 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d3dacdb3-e4f8-48d4-9e28-a26341c29477 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:30.275649 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d3dacdb3-e4f8-48d4-9e28-a26341c29477 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:30.276961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d3dacdb3-e4f8-48d4-9e28-a26341c29477 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1656 microversion: 2.20 time: 0.104389 Jun 02 14:01:30.277541 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 329/683] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:30 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1656 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:01:30.290427 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fff523fc-2359-4f2b-bf9b-a04047df8c5a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:30.291118 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-fff523fc-2359-4f2b-bf9b-a04047df8c5a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:30.297604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fff523fc-2359-4f2b-bf9b-a04047df8c5a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:30.298052 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fff523fc-2359-4f2b-bf9b-a04047df8c5a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:30.299710 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fff523fc-2359-4f2b-bf9b-a04047df8c5a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:30.300329 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fff523fc-2359-4f2b-bf9b-a04047df8c5a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:30.569608 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-fff523fc-2359-4f2b-bf9b-a04047df8c5a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:30.579708 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-fff523fc-2359-4f2b-bf9b-a04047df8c5a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1760 microversion: 2.1 time: 0.296758 Jun 02 14:01:30.580513 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 330/684] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:30 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1760 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:30.585038 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-a71e903d-e0dc-4164-b19c-c7833a90ba38 req-39b3a976-079c-4632-91c9-ef64738dca83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d462ae-af14-4d5d-aab2-f45954429480", "name": "network-vif-deleted", "tag": "9494633c-b230-4406-ab57-d1f3d39fc4d6"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:01:30.595317 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-a71e903d-e0dc-4164-b19c-c7833a90ba38 req-39b3a976-079c-4632-91c9-ef64738dca83 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:30.595762 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-a71e903d-e0dc-4164-b19c-c7833a90ba38 req-39b3a976-079c-4632-91c9-ef64738dca83 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:30.607250 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Flavor limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 14:01:30.608787 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-a71e903d-e0dc-4164-b19c-c7833a90ba38 req-39b3a976-079c-4632-91c9-ef64738dca83 service nova] Creating event network-vif-deleted:9494633c-b230-4406-ab57-d1f3d39fc4d6 for instance 83d462ae-af14-4d5d-aab2-f45954429480 on hv-cinder-82651 Jun 02 14:01:30.609199 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Image limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 14:01:30.609906 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Flavor pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 14:01:30.610529 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Image pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 14:01:30.611165 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 14:01:30.614123 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-a71e903d-e0dc-4164-b19c-c7833a90ba38 req-39b3a976-079c-4632-91c9-ef64738dca83 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032677 Jun 02 14:01:30.614912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 331/685] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:01:30.621796 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:30.622243 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:30.623037 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:30.623470 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:30.641478 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Getting quotas for project b55a34a53b2740d9af5efd660424a456. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:01:30.646105 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Getting quotas for user 315c0d9d9a284389ae07bf898c330605 and project b55a34a53b2740d9af5efd660424a456. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:01:30.710658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Going to run 1 instances... {{(pid=118316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 14:01:30.712797 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='580c5bdb-e969-4779-b3b5-00c78d8a8ee0',volume_size=None,volume_type=None)] {{(pid=118316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 14:01:30.850298 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-747a7f63-6fc8-474a-a6c2-abbbebf1deca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:30.850991 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-747a7f63-6fc8-474a-a6c2-abbbebf1deca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:30.857500 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-747a7f63-6fc8-474a-a6c2-abbbebf1deca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:30.857954 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-747a7f63-6fc8-474a-a6c2-abbbebf1deca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:30.860046 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-747a7f63-6fc8-474a-a6c2-abbbebf1deca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:30.860505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-747a7f63-6fc8-474a-a6c2-abbbebf1deca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:31.002733 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-747a7f63-6fc8-474a-a6c2-abbbebf1deca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:31.010344 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-747a7f63-6fc8-474a-a6c2-abbbebf1deca tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.164331 Jun 02 14:01:31.014815 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 332/686] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:30 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:31.296867 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-334c4fa7-3a8d-4ffe-8376-307338d237d5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:31.297472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-334c4fa7-3a8d-4ffe-8376-307338d237d5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:31.301018 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8d712da7-af7b-4307-b23b-22a7c4aa9f54 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.404716 Jun 02 14:01:31.301789 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 355/687] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 14:01:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 14:01:31.304257 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-334c4fa7-3a8d-4ffe-8376-307338d237d5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:31.304727 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-334c4fa7-3a8d-4ffe-8376-307338d237d5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:31.305490 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-334c4fa7-3a8d-4ffe-8376-307338d237d5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:31.305919 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-334c4fa7-3a8d-4ffe-8376-307338d237d5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:31.312199 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5ea35824-8700-4880-9e6c-d044076848f4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:31.312856 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-5ea35824-8700-4880-9e6c-d044076848f4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:31.354527 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-334c4fa7-3a8d-4ffe-8376-307338d237d5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:31.355366 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-334c4fa7-3a8d-4ffe-8376-307338d237d5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:31.356077 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-334c4fa7-3a8d-4ffe-8376-307338d237d5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lazy-loading 'fault' on Instance uuid 83d462ae-af14-4d5d-aab2-f45954429480 {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:01:31.372448 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5ea35824-8700-4880-9e6c-d044076848f4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:31.382554 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5ea35824-8700-4880-9e6c-d044076848f4 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1095 microversion: 2.1 time: 0.072175 Jun 02 14:01:31.383267 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 356/688] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:31 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:31.402731 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-334c4fa7-3a8d-4ffe-8376-307338d237d5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:31.412196 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-334c4fa7-3a8d-4ffe-8376-307338d237d5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:31.413718 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-334c4fa7-3a8d-4ffe-8376-307338d237d5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:31.415036 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-334c4fa7-3a8d-4ffe-8376-307338d237d5 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 200 len: 1371 microversion: 2.20 time: 0.122803 Jun 02 14:01:31.415670 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 333/689] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:31 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 1371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:01:32.026998 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-18381522-c338-40cd-88fe-581f1d4a91d4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:32.027701 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-18381522-c338-40cd-88fe-581f1d4a91d4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:32.034437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-18381522-c338-40cd-88fe-581f1d4a91d4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:32.034843 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-18381522-c338-40cd-88fe-581f1d4a91d4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:32.035599 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-18381522-c338-40cd-88fe-581f1d4a91d4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:32.036066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-18381522-c338-40cd-88fe-581f1d4a91d4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:32.167445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-18381522-c338-40cd-88fe-581f1d4a91d4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:32.175451 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-18381522-c338-40cd-88fe-581f1d4a91d4 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.152288 Jun 02 14:01:32.176013 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 357/690] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:32 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:32.399106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7655b424-c79e-466b-93e0-43bb2e79c1ca tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:32.399730 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7655b424-c79e-466b-93e0-43bb2e79c1ca tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:32.407143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7655b424-c79e-466b-93e0-43bb2e79c1ca tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:32.407578 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7655b424-c79e-466b-93e0-43bb2e79c1ca tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:32.408322 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7655b424-c79e-466b-93e0-43bb2e79c1ca tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:32.408773 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7655b424-c79e-466b-93e0-43bb2e79c1ca tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:32.434172 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-54445e42-2dc2-4292-9295-ba2619fd0376 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:32.435451 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-54445e42-2dc2-4292-9295-ba2619fd0376 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:32.441701 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-54445e42-2dc2-4292-9295-ba2619fd0376 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:32.442146 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-54445e42-2dc2-4292-9295-ba2619fd0376 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:32.443115 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-54445e42-2dc2-4292-9295-ba2619fd0376 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:32.443876 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-54445e42-2dc2-4292-9295-ba2619fd0376 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:32.458649 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-54445e42-2dc2-4292-9295-ba2619fd0376 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] HTTP exception thrown: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-54445e42-2dc2-4292-9295-ba2619fd0376 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Request method failure captured: Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 HTTP/1.1 Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMD5fBY611s0IJQJMfIGFLSLVCOkBZHb_yepGHcJiB6KvP-MiQMyMxNg_CuchRnE2JWaPZoLKjlUnspRoiu7nL2pM9l0tLaxDdfmxHr37rQc2t69UpMK5zXrvgdtAb4cXP5mdI04Z3d9z5ZBdCKB6s2RR7dSIsT6jI1Q_fbNGVP_f8Y Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 56c3f04e3f164a77b32b1e320d979863 Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:01:32.460227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:01:32.461926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:01:32.461926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:01:32.461926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 56c3f04e3f164a77b32b1e320d979863 Jun 02 14:01:32.461926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:01:32.461926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-AttachVolumeShelveTestJSON-584569326-project Jun 02 14:01:32.461926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:01:32.461926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:01:32.461926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 4dd10f5fa400450fb64360391a871bb8 Jun 02 14:01:32.461926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-AttachVolumeShelveTestJSON-584569326-project Jun 02 14:01:32.461926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:01:32.461926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:01:32.461926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': '83d462ae-af14-4d5d-aab2-f45954429480'} Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:01:32.462865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:01:32.464330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:01:32.466307 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-54445e42-2dc2-4292-9295-ba2619fd0376 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Returning 404 to user: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:01:32.467148 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-54445e42-2dc2-4292-9295-ba2619fd0376 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 404 len: 111 microversion: 2.20 time: 0.037034 Jun 02 14:01:32.468527 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 358/691] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:32 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 02 14:01:32.475435 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7655b424-c79e-466b-93e0-43bb2e79c1ca tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:32.477217 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c257c628-2a13-4a5a-b4d9-1810fc2099ca tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '.version_select at 0x7fb71ada0d30>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:32.483823 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7655b424-c79e-466b-93e0-43bb2e79c1ca tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1145 microversion: 2.1 time: 0.087942 Jun 02 14:01:32.492703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 334/692] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:32 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:32.564209 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c257c628-2a13-4a5a-b4d9-1810fc2099ca tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218029708" status: 204 len: 0 microversion: 2.20 time: 0.090494 Jun 02 14:01:32.564857 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 359/693] 10.222.0.33 () {60 vars in 1261 bytes} [Thu Jun 2 14:01:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218029708 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 14:01:33.193299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-65e5accb-8075-4c73-a0e5-968565aace10 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:33.193904 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-65e5accb-8075-4c73-a0e5-968565aace10 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:33.200234 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-65e5accb-8075-4c73-a0e5-968565aace10 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:33.200710 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-65e5accb-8075-4c73-a0e5-968565aace10 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:33.201456 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-65e5accb-8075-4c73-a0e5-968565aace10 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:33.202270 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-65e5accb-8075-4c73-a0e5-968565aace10 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:33.349335 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-65e5accb-8075-4c73-a0e5-968565aace10 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:33.358925 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-65e5accb-8075-4c73-a0e5-968565aace10 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.168859 Jun 02 14:01:33.359694 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 335/694] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:33 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:33.387624 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d400f7cc-03be-47c6-b71a-f794e5e0b417 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Action: 'create', calling method: .version_select at 0x7fb71aff9940>, body: {"keypair": {"name": "tempest-keypair-1116485922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6ckW23e+8GW2x61B0Wd6huDF9Nef1rqtb5sJdS0BtA4yvBUSfWjNdaGI1GQemB05SkyepgJxDjK2DW8/21r+VU03O1eotNWUhmn9k2L6Kc0SbpgE2vzXo6/Wkn9V1wUQ=="}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:01:33.402861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-d400f7cc-03be-47c6-b71a-f794e5e0b417 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Getting quotas for project 56c3f04e3f164a77b32b1e320d979863. Resources: {'key_pairs'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:01:33.407291 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-d400f7cc-03be-47c6-b71a-f794e5e0b417 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Getting quotas for user 4dd10f5fa400450fb64360391a871bb8 and project 56c3f04e3f164a77b32b1e320d979863. Resources: {'key_pairs'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:01:33.501818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f42b1241-82b1-4d47-9461-a2b20b49c7b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:33.502228 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f42b1241-82b1-4d47-9461-a2b20b49c7b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:33.508443 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f42b1241-82b1-4d47-9461-a2b20b49c7b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:33.508907 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f42b1241-82b1-4d47-9461-a2b20b49c7b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:33.509674 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f42b1241-82b1-4d47-9461-a2b20b49c7b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:33.510106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f42b1241-82b1-4d47-9461-a2b20b49c7b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:33.540033 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d400f7cc-03be-47c6-b71a-f794e5e0b417 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.156626 Jun 02 14:01:33.540699 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 360/695] 10.222.0.33 () {62 vars in 1199 bytes} [Thu Jun 2 14:01:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 02 14:01:33.585818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f42b1241-82b1-4d47-9461-a2b20b49c7b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:33.594008 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f42b1241-82b1-4d47-9461-a2b20b49c7b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1201 microversion: 2.1 time: 0.097193 Jun 02 14:01:33.594652 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 336/696] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:33 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1201 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:34.395330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2af15db0-7e76-435c-a5a3-1f3ddb2a31ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:34.396056 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2af15db0-7e76-435c-a5a3-1f3ddb2a31ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:34.399999 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:34.403551 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2af15db0-7e76-435c-a5a3-1f3ddb2a31ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:34.407046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2af15db0-7e76-435c-a5a3-1f3ddb2a31ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:34.412913 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2af15db0-7e76-435c-a5a3-1f3ddb2a31ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:34.412913 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2af15db0-7e76-435c-a5a3-1f3ddb2a31ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:34.586509 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2af15db0-7e76-435c-a5a3-1f3ddb2a31ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:34.594605 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2af15db0-7e76-435c-a5a3-1f3ddb2a31ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.213279 Jun 02 14:01:34.595199 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 361/697] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:34 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:34.612229 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1c07aa2b-05f6-4d49-9d4a-64c9657dcab8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:34.619230 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1c07aa2b-05f6-4d49-9d4a-64c9657dcab8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:34.619684 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1c07aa2b-05f6-4d49-9d4a-64c9657dcab8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:34.620136 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1c07aa2b-05f6-4d49-9d4a-64c9657dcab8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:34.620940 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1c07aa2b-05f6-4d49-9d4a-64c9657dcab8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:34.621381 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1c07aa2b-05f6-4d49-9d4a-64c9657dcab8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:34.792008 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1c07aa2b-05f6-4d49-9d4a-64c9657dcab8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:34.800297 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1c07aa2b-05f6-4d49-9d4a-64c9657dcab8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1278 microversion: 2.1 time: 0.192602 Jun 02 14:01:34.802116 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 337/698] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:34 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:35.611738 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3ec467a4-83c1-4bc5-963f-7e1ce103b713 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:35.612344 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3ec467a4-83c1-4bc5-963f-7e1ce103b713 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:35.619083 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3ec467a4-83c1-4bc5-963f-7e1ce103b713 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:35.619524 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3ec467a4-83c1-4bc5-963f-7e1ce103b713 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:35.620279 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3ec467a4-83c1-4bc5-963f-7e1ce103b713 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:35.620735 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3ec467a4-83c1-4bc5-963f-7e1ce103b713 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:35.723200 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-9c7bb0f7-bafa-49f2-9452-88c51235dc48 req-ccabfc66-2c8b-4789-9ad7-8030fd6e4d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d778df4-cdc9-440b-acda-4b10357cb31f", "tag": "1bbbd139-07e3-43f6-afa9-e2d8b6eb9d5e"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:01:35.733959 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-9c7bb0f7-bafa-49f2-9452-88c51235dc48 req-ccabfc66-2c8b-4789-9ad7-8030fd6e4d2c service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:35.735165 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-9c7bb0f7-bafa-49f2-9452-88c51235dc48 req-ccabfc66-2c8b-4789-9ad7-8030fd6e4d2c service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:35.754543 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-9c7bb0f7-bafa-49f2-9452-88c51235dc48 req-ccabfc66-2c8b-4789-9ad7-8030fd6e4d2c service nova] Creating event network-changed:1bbbd139-07e3-43f6-afa9-e2d8b6eb9d5e for instance 6d778df4-cdc9-440b-acda-4b10357cb31f on hv-cinder-82651 Jun 02 14:01:35.761019 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-9c7bb0f7-bafa-49f2-9452-88c51235dc48 req-ccabfc66-2c8b-4789-9ad7-8030fd6e4d2c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041803 Jun 02 14:01:35.761985 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 338/699] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:01:35.825063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e9ebd2e0-a4c9-4389-8f23-628e2b5b74aa tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:35.826062 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e9ebd2e0-a4c9-4389-8f23-628e2b5b74aa tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:35.836565 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e9ebd2e0-a4c9-4389-8f23-628e2b5b74aa tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:35.841617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e9ebd2e0-a4c9-4389-8f23-628e2b5b74aa tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:35.841617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e9ebd2e0-a4c9-4389-8f23-628e2b5b74aa tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:35.841617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e9ebd2e0-a4c9-4389-8f23-628e2b5b74aa tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:35.846269 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3ec467a4-83c1-4bc5-963f-7e1ce103b713 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:35.864586 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3ec467a4-83c1-4bc5-963f-7e1ce103b713 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.256996 Jun 02 14:01:35.867146 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 362/700] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:35 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:36.066438 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e9ebd2e0-a4c9-4389-8f23-628e2b5b74aa tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:36.074393 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e9ebd2e0-a4c9-4389-8f23-628e2b5b74aa tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.255540 Jun 02 14:01:36.078975 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 339/701] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:35 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:36.342294 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-377205307", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5559c4cf-ba93-4965-bd8e-405e569a88a3"}], "security_groups": [{"name": "tempest-securitygroup--2054638290"}], "key_name": "tempest-keypair-1116485922", "user_data": "}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:01:36.445560 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.network.neutron [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] validate_networks() for [('5559c4cf-ba93-4965-bd8e-405e569a88a3', None, None, None, None, None)] {{(pid=118316) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 14:01:36.810146 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Flavor limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 14:01:36.810711 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Image limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 14:01:36.811074 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Flavor pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 14:01:36.811485 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Image pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 14:01:36.811894 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 14:01:36.820605 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:36.821053 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:36.821847 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:36.822283 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:36.838904 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Getting quotas for project 56c3f04e3f164a77b32b1e320d979863. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:01:36.843510 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Getting quotas for user 4dd10f5fa400450fb64360391a871bb8 and project 56c3f04e3f164a77b32b1e320d979863. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:01:36.854295 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Going to run 1 instances... {{(pid=118316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 14:01:36.856387 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 14:01:36.882992 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-dea79d95-1f54-442d-bc62-cad87c3e9936 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:36.883668 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-dea79d95-1f54-442d-bc62-cad87c3e9936 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:36.890938 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dea79d95-1f54-442d-bc62-cad87c3e9936 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:36.891384 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dea79d95-1f54-442d-bc62-cad87c3e9936 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:36.892139 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dea79d95-1f54-442d-bc62-cad87c3e9936 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:36.892657 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dea79d95-1f54-442d-bc62-cad87c3e9936 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:36.911065 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=100 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:36.990878 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-13a8adee-8689-4895-8b41-aa720c87bd83 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.653368 Jun 02 14:01:36.996536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 363/702] 10.222.0.33 () {62 vars in 1187 bytes} [Thu Jun 2 14:01:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 02 14:01:37.002098 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a2f4c821-7a60-4c14-bc20-555dd546642c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:37.002699 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a2f4c821-7a60-4c14-bc20-555dd546642c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:37.043917 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-dea79d95-1f54-442d-bc62-cad87c3e9936 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:37.052143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-dea79d95-1f54-442d-bc62-cad87c3e9936 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.172884 Jun 02 14:01:37.052831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 340/703] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:36 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:37.064800 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a2f4c821-7a60-4c14-bc20-555dd546642c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:37.074507 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a2f4c821-7a60-4c14-bc20-555dd546642c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:37.076018 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a2f4c821-7a60-4c14-bc20-555dd546642c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:37.078888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a2f4c821-7a60-4c14-bc20-555dd546642c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1281 microversion: 2.20 time: 0.081347 Jun 02 14:01:37.079449 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 364/704] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:36 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:37.091531 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-6b063c38-06cb-472c-aaa6-f9355c9f8c28 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:37.092293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-6b063c38-06cb-472c-aaa6-f9355c9f8c28 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:37.098509 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6b063c38-06cb-472c-aaa6-f9355c9f8c28 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:37.098958 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6b063c38-06cb-472c-aaa6-f9355c9f8c28 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:37.099727 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6b063c38-06cb-472c-aaa6-f9355c9f8c28 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:37.100162 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6b063c38-06cb-472c-aaa6-f9355c9f8c28 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:37.433778 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6b063c38-06cb-472c-aaa6-f9355c9f8c28 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:37.441705 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-6b063c38-06cb-472c-aaa6-f9355c9f8c28 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.353977 Jun 02 14:01:37.447162 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 341/705] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:37 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:38.069345 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3d7a9e67-d9c4-4fb8-8a23-6b1793f36778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:38.069990 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3d7a9e67-d9c4-4fb8-8a23-6b1793f36778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:38.077568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3d7a9e67-d9c4-4fb8-8a23-6b1793f36778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:38.078025 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3d7a9e67-d9c4-4fb8-8a23-6b1793f36778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:38.078787 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3d7a9e67-d9c4-4fb8-8a23-6b1793f36778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:38.079224 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3d7a9e67-d9c4-4fb8-8a23-6b1793f36778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:38.096676 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0dd20522-17d1-4a40-bcad-1b9d9edb4702 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:38.097428 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0dd20522-17d1-4a40-bcad-1b9d9edb4702 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:38.104161 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0dd20522-17d1-4a40-bcad-1b9d9edb4702 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:38.104642 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0dd20522-17d1-4a40-bcad-1b9d9edb4702 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:38.105405 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0dd20522-17d1-4a40-bcad-1b9d9edb4702 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:38.105835 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0dd20522-17d1-4a40-bcad-1b9d9edb4702 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:38.176519 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0dd20522-17d1-4a40-bcad-1b9d9edb4702 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:38.185061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0dd20522-17d1-4a40-bcad-1b9d9edb4702 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:38.187211 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0dd20522-17d1-4a40-bcad-1b9d9edb4702 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:38.188331 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0dd20522-17d1-4a40-bcad-1b9d9edb4702 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1285 microversion: 2.20 time: 0.095593 Jun 02 14:01:38.199057 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 342/706] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:38 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:01:38.239316 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3d7a9e67-d9c4-4fb8-8a23-6b1793f36778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:38.246985 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3d7a9e67-d9c4-4fb8-8a23-6b1793f36778 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.181659 Jun 02 14:01:38.247549 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 365/707] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:38 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:38.459017 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3cade74d-4567-47d6-8d85-4109427ff229 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:38.459650 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3cade74d-4567-47d6-8d85-4109427ff229 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:38.465818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3cade74d-4567-47d6-8d85-4109427ff229 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:38.466260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3cade74d-4567-47d6-8d85-4109427ff229 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:38.467029 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3cade74d-4567-47d6-8d85-4109427ff229 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:38.467615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3cade74d-4567-47d6-8d85-4109427ff229 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:38.597652 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3cade74d-4567-47d6-8d85-4109427ff229 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:38.605061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3cade74d-4567-47d6-8d85-4109427ff229 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.149909 Jun 02 14:01:38.605622 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 343/708] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:38 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:39.206832 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7bf58469-bd8f-44f1-bd17-afb78e9cec7c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:39.207449 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7bf58469-bd8f-44f1-bd17-afb78e9cec7c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:39.213960 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7bf58469-bd8f-44f1-bd17-afb78e9cec7c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:39.214406 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7bf58469-bd8f-44f1-bd17-afb78e9cec7c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:39.215156 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7bf58469-bd8f-44f1-bd17-afb78e9cec7c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:39.215586 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7bf58469-bd8f-44f1-bd17-afb78e9cec7c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:39.263556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-9afe5224-302e-4dfd-89dd-7fd74649c14a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:39.264689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-9afe5224-302e-4dfd-89dd-7fd74649c14a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:39.271413 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9afe5224-302e-4dfd-89dd-7fd74649c14a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:39.271868 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9afe5224-302e-4dfd-89dd-7fd74649c14a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:39.272670 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9afe5224-302e-4dfd-89dd-7fd74649c14a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:39.273106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9afe5224-302e-4dfd-89dd-7fd74649c14a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:39.276183 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7bf58469-bd8f-44f1-bd17-afb78e9cec7c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:39.284833 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7bf58469-bd8f-44f1-bd17-afb78e9cec7c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:39.286358 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7bf58469-bd8f-44f1-bd17-afb78e9cec7c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:39.287454 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7bf58469-bd8f-44f1-bd17-afb78e9cec7c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1277 microversion: 2.20 time: 0.084527 Jun 02 14:01:39.288009 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 366/709] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:39 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:39.406868 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-9afe5224-302e-4dfd-89dd-7fd74649c14a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:39.414795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-9afe5224-302e-4dfd-89dd-7fd74649c14a tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.155087 Jun 02 14:01:39.415372 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 344/710] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:39 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:39.622633 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b65a2ff7-22e2-4337-a3f8-96f964a0984a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:39.623261 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b65a2ff7-22e2-4337-a3f8-96f964a0984a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:39.629726 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b65a2ff7-22e2-4337-a3f8-96f964a0984a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:39.630169 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b65a2ff7-22e2-4337-a3f8-96f964a0984a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:39.630907 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b65a2ff7-22e2-4337-a3f8-96f964a0984a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:39.631330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b65a2ff7-22e2-4337-a3f8-96f964a0984a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:39.635144 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:39.768887 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b65a2ff7-22e2-4337-a3f8-96f964a0984a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:39.775631 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b65a2ff7-22e2-4337-a3f8-96f964a0984a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.156821 Jun 02 14:01:39.776221 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 367/711] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:39 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:40.305387 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d3a4aad9-68ff-4c8b-bb23-5a45ab40a01e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:40.306159 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d3a4aad9-68ff-4c8b-bb23-5a45ab40a01e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:40.313233 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3a4aad9-68ff-4c8b-bb23-5a45ab40a01e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:40.313622 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3a4aad9-68ff-4c8b-bb23-5a45ab40a01e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:40.314375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3a4aad9-68ff-4c8b-bb23-5a45ab40a01e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:40.314812 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3a4aad9-68ff-4c8b-bb23-5a45ab40a01e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:40.378465 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d3a4aad9-68ff-4c8b-bb23-5a45ab40a01e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:40.386719 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d3a4aad9-68ff-4c8b-bb23-5a45ab40a01e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:40.388241 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d3a4aad9-68ff-4c8b-bb23-5a45ab40a01e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:40.390220 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d3a4aad9-68ff-4c8b-bb23-5a45ab40a01e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1333 microversion: 2.20 time: 0.087922 Jun 02 14:01:40.390790 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 345/712] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:40 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:40.432866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f9072e78-6591-4682-85b2-ace6c53a7971 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:40.433503 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f9072e78-6591-4682-85b2-ace6c53a7971 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:40.440892 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f9072e78-6591-4682-85b2-ace6c53a7971 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:40.441339 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f9072e78-6591-4682-85b2-ace6c53a7971 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:40.442136 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f9072e78-6591-4682-85b2-ace6c53a7971 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:40.442568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f9072e78-6591-4682-85b2-ace6c53a7971 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:40.581824 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f9072e78-6591-4682-85b2-ace6c53a7971 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:40.594843 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f9072e78-6591-4682-85b2-ace6c53a7971 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.165705 Jun 02 14:01:40.595802 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 368/713] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:40 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:40.818789 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-6e4f6d80-5918-4298-b58e-8f7c072007f2 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:40.818789 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-6e4f6d80-5918-4298-b58e-8f7c072007f2 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:40.818789 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6e4f6d80-5918-4298-b58e-8f7c072007f2 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:40.818789 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6e4f6d80-5918-4298-b58e-8f7c072007f2 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:40.819226 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6e4f6d80-5918-4298-b58e-8f7c072007f2 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:40.819226 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6e4f6d80-5918-4298-b58e-8f7c072007f2 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:40.945965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6e4f6d80-5918-4298-b58e-8f7c072007f2 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:40.954829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-6e4f6d80-5918-4298-b58e-8f7c072007f2 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.165560 Jun 02 14:01:40.963766 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 346/714] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:40 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:40.988015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-6ecd0877-3ad5-4a8f-b137-6a4cb6fc1b09 req-bb710971-1073-44aa-b965-d5e9647171df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4253a95d-5443-4a20-9a10-621c058e8674", "name": "network-vif-unplugged", "status": "completed", "tag": "7e76fdd4-e430-47ed-aee9-504128683d44"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:01:40.996218 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-6ecd0877-3ad5-4a8f-b137-6a4cb6fc1b09 req-bb710971-1073-44aa-b965-d5e9647171df service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:40.996696 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-6ecd0877-3ad5-4a8f-b137-6a4cb6fc1b09 req-bb710971-1073-44aa-b965-d5e9647171df service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:41.008970 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-6ecd0877-3ad5-4a8f-b137-6a4cb6fc1b09 req-bb710971-1073-44aa-b965-d5e9647171df service nova] Creating event network-vif-unplugged:7e76fdd4-e430-47ed-aee9-504128683d44 for instance 4253a95d-5443-4a20-9a10-621c058e8674 on hv-cinder-82651 Jun 02 14:01:41.015455 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-6ecd0877-3ad5-4a8f-b137-6a4cb6fc1b09 req-bb710971-1073-44aa-b965-d5e9647171df service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032438 Jun 02 14:01:41.016230 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 369/715] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:01:41.408617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0aae8bfa-601b-4973-b94a-a34c1cc46d51 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:41.409173 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0aae8bfa-601b-4973-b94a-a34c1cc46d51 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:41.418125 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0aae8bfa-601b-4973-b94a-a34c1cc46d51 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:41.418802 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0aae8bfa-601b-4973-b94a-a34c1cc46d51 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:41.419870 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0aae8bfa-601b-4973-b94a-a34c1cc46d51 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:41.422082 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0aae8bfa-601b-4973-b94a-a34c1cc46d51 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:41.579980 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0aae8bfa-601b-4973-b94a-a34c1cc46d51 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:41.589593 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0aae8bfa-601b-4973-b94a-a34c1cc46d51 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:41.591106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0aae8bfa-601b-4973-b94a-a34c1cc46d51 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:41.592347 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0aae8bfa-601b-4973-b94a-a34c1cc46d51 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1407 microversion: 2.20 time: 0.188142 Jun 02 14:01:41.593342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 347/716] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:41 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:41.614313 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f700a4a4-7098-4fbb-9887-5a2806c6d589 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:41.615118 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f700a4a4-7098-4fbb-9887-5a2806c6d589 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:41.624852 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f700a4a4-7098-4fbb-9887-5a2806c6d589 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:41.625585 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f700a4a4-7098-4fbb-9887-5a2806c6d589 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:41.626857 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f700a4a4-7098-4fbb-9887-5a2806c6d589 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:41.627555 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f700a4a4-7098-4fbb-9887-5a2806c6d589 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:41.774263 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f700a4a4-7098-4fbb-9887-5a2806c6d589 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:41.782336 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f700a4a4-7098-4fbb-9887-5a2806c6d589 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1511 microversion: 2.1 time: 0.173350 Jun 02 14:01:41.782940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 370/717] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:41 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:41.799018 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a64c1001-cf19-4cd6-a8a1-828e35954a6f tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:01:41.799583 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a64c1001-cf19-4cd6-a8a1-828e35954a6f tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:41.805632 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a64c1001-cf19-4cd6-a8a1-828e35954a6f tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:41.806081 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a64c1001-cf19-4cd6-a8a1-828e35954a6f tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:41.806838 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a64c1001-cf19-4cd6-a8a1-828e35954a6f tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:41.807285 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a64c1001-cf19-4cd6-a8a1-828e35954a6f tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:41.971177 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-eeb5b904-53dc-48f2-b45e-77b12ed11875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:41.971791 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-eeb5b904-53dc-48f2-b45e-77b12ed11875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:41.978123 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eeb5b904-53dc-48f2-b45e-77b12ed11875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:41.978383 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eeb5b904-53dc-48f2-b45e-77b12ed11875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:41.979203 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eeb5b904-53dc-48f2-b45e-77b12ed11875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:41.979639 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eeb5b904-53dc-48f2-b45e-77b12ed11875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:42.115856 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a64c1001-cf19-4cd6-a8a1-828e35954a6f tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "POST /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674/action" status: 202 len: 0 microversion: 2.1 time: 0.320915 Jun 02 14:01:42.116492 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 348/718] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 2 14:01:41 2022] POST /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:01:42.135824 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-eeb5b904-53dc-48f2-b45e-77b12ed11875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:42.137757 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-edeb92f8-f5fb-4d7c-a263-b0ddd1d1b412 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:42.138381 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-edeb92f8-f5fb-4d7c-a263-b0ddd1d1b412 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:42.146009 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-edeb92f8-f5fb-4d7c-a263-b0ddd1d1b412 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:42.146220 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-eeb5b904-53dc-48f2-b45e-77b12ed11875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.178570 Jun 02 14:01:42.146427 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-edeb92f8-f5fb-4d7c-a263-b0ddd1d1b412 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:42.147238 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-edeb92f8-f5fb-4d7c-a263-b0ddd1d1b412 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:42.147623 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 371/719] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:41 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:42.147742 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-edeb92f8-f5fb-4d7c-a263-b0ddd1d1b412 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:42.301873 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-edeb92f8-f5fb-4d7c-a263-b0ddd1d1b412 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:42.316156 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-edeb92f8-f5fb-4d7c-a263-b0ddd1d1b412 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1519 microversion: 2.1 time: 0.195292 Jun 02 14:01:42.321454 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 349/720] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:42 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:42.535295 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-5beee288-4346-4881-9541-7e92d7315937 req-f9692799-e0a1-47c8-9b45-a960e0637137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96011da5-6967-44e1-af2c-2ad76c52da74", "tag": "ef61b669-91ec-4f6a-b126-1de24442c7c0"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:01:42.543751 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-5beee288-4346-4881-9541-7e92d7315937 req-f9692799-e0a1-47c8-9b45-a960e0637137 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:42.544464 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-5beee288-4346-4881-9541-7e92d7315937 req-f9692799-e0a1-47c8-9b45-a960e0637137 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:42.558331 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-5beee288-4346-4881-9541-7e92d7315937 req-f9692799-e0a1-47c8-9b45-a960e0637137 service nova] Creating event network-changed:ef61b669-91ec-4f6a-b126-1de24442c7c0 for instance 96011da5-6967-44e1-af2c-2ad76c52da74 on hv-cinder-82651 Jun 02 14:01:42.564290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-5beee288-4346-4881-9541-7e92d7315937 req-f9692799-e0a1-47c8-9b45-a960e0637137 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031920 Jun 02 14:01:42.565497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 372/721] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:01:42.612660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4589702b-7de5-46e5-a8f1-75db3d7d826c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:42.613643 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4589702b-7de5-46e5-a8f1-75db3d7d826c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:42.616062 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:42.628433 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4589702b-7de5-46e5-a8f1-75db3d7d826c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:42.628909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4589702b-7de5-46e5-a8f1-75db3d7d826c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:42.630196 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4589702b-7de5-46e5-a8f1-75db3d7d826c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:42.630790 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4589702b-7de5-46e5-a8f1-75db3d7d826c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:42.789864 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4589702b-7de5-46e5-a8f1-75db3d7d826c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:42.798969 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4589702b-7de5-46e5-a8f1-75db3d7d826c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:42.800708 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4589702b-7de5-46e5-a8f1-75db3d7d826c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:42.801901 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4589702b-7de5-46e5-a8f1-75db3d7d826c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1407 microversion: 2.20 time: 0.194379 Jun 02 14:01:42.802569 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 350/722] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:42 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:01:43.164094 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9e6ecd97-6364-448d-8706-ec531f733f35 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:43.165846 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9e6ecd97-6364-448d-8706-ec531f733f35 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:43.172613 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9e6ecd97-6364-448d-8706-ec531f733f35 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:43.173063 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9e6ecd97-6364-448d-8706-ec531f733f35 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:43.173825 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9e6ecd97-6364-448d-8706-ec531f733f35 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:43.174257 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9e6ecd97-6364-448d-8706-ec531f733f35 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:43.316377 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9e6ecd97-6364-448d-8706-ec531f733f35 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:43.324949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9e6ecd97-6364-448d-8706-ec531f733f35 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.165379 Jun 02 14:01:43.325536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 373/723] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:43 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:43.333449 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-00862329-8de7-475c-b5c7-7908b41a3068 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:43.334051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-00862329-8de7-475c-b5c7-7908b41a3068 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:43.341658 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00862329-8de7-475c-b5c7-7908b41a3068 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:43.342923 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00862329-8de7-475c-b5c7-7908b41a3068 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:43.343544 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00862329-8de7-475c-b5c7-7908b41a3068 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:43.343973 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00862329-8de7-475c-b5c7-7908b41a3068 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:43.486023 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-00862329-8de7-475c-b5c7-7908b41a3068 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:43.494332 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-00862329-8de7-475c-b5c7-7908b41a3068 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1521 microversion: 2.1 time: 0.164621 Jun 02 14:01:43.509238 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 351/724] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:43 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:43.820189 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9128b5fb-1065-4ef9-aa19-fdd9cffb1cac tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:43.820763 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9128b5fb-1065-4ef9-aa19-fdd9cffb1cac tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:43.827438 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9128b5fb-1065-4ef9-aa19-fdd9cffb1cac tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:43.827890 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9128b5fb-1065-4ef9-aa19-fdd9cffb1cac tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:43.828718 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9128b5fb-1065-4ef9-aa19-fdd9cffb1cac tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:43.829154 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9128b5fb-1065-4ef9-aa19-fdd9cffb1cac tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:43.960134 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9128b5fb-1065-4ef9-aa19-fdd9cffb1cac tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:43.968684 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9128b5fb-1065-4ef9-aa19-fdd9cffb1cac tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:43.970212 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9128b5fb-1065-4ef9-aa19-fdd9cffb1cac tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:43.971354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9128b5fb-1065-4ef9-aa19-fdd9cffb1cac tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1407 microversion: 2.20 time: 0.155211 Jun 02 14:01:43.971910 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 374/725] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:43 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:44.342194 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-387bd762-7f8b-4c7d-bbec-dfd203c9ba8d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:44.342849 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-387bd762-7f8b-4c7d-bbec-dfd203c9ba8d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:44.349359 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-387bd762-7f8b-4c7d-bbec-dfd203c9ba8d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:44.349804 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-387bd762-7f8b-4c7d-bbec-dfd203c9ba8d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:44.350554 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-387bd762-7f8b-4c7d-bbec-dfd203c9ba8d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:44.350984 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-387bd762-7f8b-4c7d-bbec-dfd203c9ba8d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:44.484328 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-387bd762-7f8b-4c7d-bbec-dfd203c9ba8d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:44.491941 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-387bd762-7f8b-4c7d-bbec-dfd203c9ba8d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.153553 Jun 02 14:01:44.492499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 352/726] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:44 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:44.512328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5a1ff287-da1b-48c4-a205-2fd6e2223780 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:44.512976 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-5a1ff287-da1b-48c4-a205-2fd6e2223780 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:44.519689 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5a1ff287-da1b-48c4-a205-2fd6e2223780 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:44.520162 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5a1ff287-da1b-48c4-a205-2fd6e2223780 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:44.520939 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5a1ff287-da1b-48c4-a205-2fd6e2223780 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:44.521362 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5a1ff287-da1b-48c4-a205-2fd6e2223780 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:44.648823 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5a1ff287-da1b-48c4-a205-2fd6e2223780 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:44.656379 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5a1ff287-da1b-48c4-a205-2fd6e2223780 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1521 microversion: 2.1 time: 0.147842 Jun 02 14:01:44.656970 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 375/727] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:44 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:44.989747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-626c6642-53cd-45dd-bd09-18433d2c6b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:44.990331 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-626c6642-53cd-45dd-bd09-18433d2c6b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:44.996580 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-626c6642-53cd-45dd-bd09-18433d2c6b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:44.997031 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-626c6642-53cd-45dd-bd09-18433d2c6b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:44.997809 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-626c6642-53cd-45dd-bd09-18433d2c6b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:44.998264 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-626c6642-53cd-45dd-bd09-18433d2c6b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:45.288395 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-626c6642-53cd-45dd-bd09-18433d2c6b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:45.296694 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-626c6642-53cd-45dd-bd09-18433d2c6b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:45.298212 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-626c6642-53cd-45dd-bd09-18433d2c6b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:45.299314 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-626c6642-53cd-45dd-bd09-18433d2c6b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1407 microversion: 2.20 time: 0.313514 Jun 02 14:01:45.299866 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 353/728] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:44 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:45.509738 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ea7cf4cb-8560-47f3-b76d-b5df81be1f8a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:45.510349 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ea7cf4cb-8560-47f3-b76d-b5df81be1f8a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:45.517526 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ea7cf4cb-8560-47f3-b76d-b5df81be1f8a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:45.518067 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ea7cf4cb-8560-47f3-b76d-b5df81be1f8a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:45.518737 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ea7cf4cb-8560-47f3-b76d-b5df81be1f8a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:45.519168 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ea7cf4cb-8560-47f3-b76d-b5df81be1f8a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:45.649573 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ea7cf4cb-8560-47f3-b76d-b5df81be1f8a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:45.657002 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ea7cf4cb-8560-47f3-b76d-b5df81be1f8a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.151142 Jun 02 14:01:45.657571 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 376/729] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:45 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:45.672536 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d1b7db54-7bf4-42f2-866e-da9ea8f00370 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:45.673152 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d1b7db54-7bf4-42f2-866e-da9ea8f00370 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:45.679489 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d1b7db54-7bf4-42f2-866e-da9ea8f00370 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:45.679941 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d1b7db54-7bf4-42f2-866e-da9ea8f00370 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:45.680732 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d1b7db54-7bf4-42f2-866e-da9ea8f00370 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:45.681168 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d1b7db54-7bf4-42f2-866e-da9ea8f00370 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:45.815496 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d1b7db54-7bf4-42f2-866e-da9ea8f00370 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:45.823164 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d1b7db54-7bf4-42f2-866e-da9ea8f00370 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1521 microversion: 2.1 time: 0.154159 Jun 02 14:01:45.823713 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 354/730] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:45 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:46.317532 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ed2c6069-7d69-4607-95dc-1451e0d0e789 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:46.318471 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ed2c6069-7d69-4607-95dc-1451e0d0e789 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:46.324453 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ed2c6069-7d69-4607-95dc-1451e0d0e789 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:46.334441 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ed2c6069-7d69-4607-95dc-1451e0d0e789 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:46.334441 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ed2c6069-7d69-4607-95dc-1451e0d0e789 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:46.334441 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ed2c6069-7d69-4607-95dc-1451e0d0e789 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:46.454356 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ed2c6069-7d69-4607-95dc-1451e0d0e789 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:46.462245 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ed2c6069-7d69-4607-95dc-1451e0d0e789 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:46.463758 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ed2c6069-7d69-4607-95dc-1451e0d0e789 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:46.464897 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ed2c6069-7d69-4607-95dc-1451e0d0e789 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1407 microversion: 2.20 time: 0.151462 Jun 02 14:01:46.465459 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 377/731] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:46 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:46.673682 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2cc133a3-be1b-41f1-b901-4f4d6e6fb2c7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:46.674218 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-2cc133a3-be1b-41f1-b901-4f4d6e6fb2c7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:46.680721 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2cc133a3-be1b-41f1-b901-4f4d6e6fb2c7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:46.681168 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2cc133a3-be1b-41f1-b901-4f4d6e6fb2c7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:46.681929 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2cc133a3-be1b-41f1-b901-4f4d6e6fb2c7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:46.682362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2cc133a3-be1b-41f1-b901-4f4d6e6fb2c7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:46.813132 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2cc133a3-be1b-41f1-b901-4f4d6e6fb2c7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:46.821040 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2cc133a3-be1b-41f1-b901-4f4d6e6fb2c7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.151073 Jun 02 14:01:46.821644 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 355/732] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:46 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:46.841086 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6f517257-6be7-4399-a1bc-3473aea109f7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:46.841807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6f517257-6be7-4399-a1bc-3473aea109f7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:46.844877 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=4 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:46.849665 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6f517257-6be7-4399-a1bc-3473aea109f7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:46.850108 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6f517257-6be7-4399-a1bc-3473aea109f7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:46.850865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6f517257-6be7-4399-a1bc-3473aea109f7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:46.851291 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6f517257-6be7-4399-a1bc-3473aea109f7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:46.980661 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6f517257-6be7-4399-a1bc-3473aea109f7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:46.988290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6f517257-6be7-4399-a1bc-3473aea109f7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1521 microversion: 2.1 time: 0.150989 Jun 02 14:01:46.988889 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 378/733] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:46 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:47.483491 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e29c0550-8e03-4b75-b506-7f1584e898b2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:47.484580 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e29c0550-8e03-4b75-b506-7f1584e898b2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:47.491054 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e29c0550-8e03-4b75-b506-7f1584e898b2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:47.491502 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e29c0550-8e03-4b75-b506-7f1584e898b2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:47.492266 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e29c0550-8e03-4b75-b506-7f1584e898b2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:47.492771 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e29c0550-8e03-4b75-b506-7f1584e898b2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:47.497370 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:47.626318 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e29c0550-8e03-4b75-b506-7f1584e898b2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:47.634435 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e29c0550-8e03-4b75-b506-7f1584e898b2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:47.639794 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e29c0550-8e03-4b75-b506-7f1584e898b2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:47.639794 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e29c0550-8e03-4b75-b506-7f1584e898b2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1407 microversion: 2.20 time: 0.157686 Jun 02 14:01:47.639794 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 356/734] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:47 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:47.839218 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b21ab6ff-f4f8-4867-9385-2bc3faa5e6ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:47.839735 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b21ab6ff-f4f8-4867-9385-2bc3faa5e6ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:47.841560 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=20 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:47.847523 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b21ab6ff-f4f8-4867-9385-2bc3faa5e6ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:47.847998 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b21ab6ff-f4f8-4867-9385-2bc3faa5e6ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:47.848798 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b21ab6ff-f4f8-4867-9385-2bc3faa5e6ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:47.849225 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b21ab6ff-f4f8-4867-9385-2bc3faa5e6ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:48.006228 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-62a656d0-2e1a-405c-b3ae-368f39c78462 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:48.006845 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-62a656d0-2e1a-405c-b3ae-368f39c78462 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:48.013554 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-62a656d0-2e1a-405c-b3ae-368f39c78462 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:48.014003 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-62a656d0-2e1a-405c-b3ae-368f39c78462 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:48.014786 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-62a656d0-2e1a-405c-b3ae-368f39c78462 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:48.015868 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-62a656d0-2e1a-405c-b3ae-368f39c78462 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:48.233776 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b21ab6ff-f4f8-4867-9385-2bc3faa5e6ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:48.238845 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-62a656d0-2e1a-405c-b3ae-368f39c78462 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:48.242010 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b21ab6ff-f4f8-4867-9385-2bc3faa5e6ae tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.406724 Jun 02 14:01:48.242575 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 379/735] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:47 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:48.246497 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-62a656d0-2e1a-405c-b3ae-368f39c78462 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1521 microversion: 2.1 time: 0.244197 Jun 02 14:01:48.247139 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 357/736] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:48 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:48.655331 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3d554da2-7a5e-4435-825a-512b453c3664 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:48.656757 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3d554da2-7a5e-4435-825a-512b453c3664 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:48.662721 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3d554da2-7a5e-4435-825a-512b453c3664 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:48.663168 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3d554da2-7a5e-4435-825a-512b453c3664 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:48.663924 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3d554da2-7a5e-4435-825a-512b453c3664 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:48.664354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3d554da2-7a5e-4435-825a-512b453c3664 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:48.796336 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3d554da2-7a5e-4435-825a-512b453c3664 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:48.807714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3d554da2-7a5e-4435-825a-512b453c3664 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:48.809246 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3d554da2-7a5e-4435-825a-512b453c3664 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:48.811062 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3d554da2-7a5e-4435-825a-512b453c3664 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1407 microversion: 2.20 time: 0.159379 Jun 02 14:01:48.812079 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 380/737] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:48 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:49.259018 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-51a9c891-2c65-4c0c-a0f9-85a8eab9fa44 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:49.259635 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-51a9c891-2c65-4c0c-a0f9-85a8eab9fa44 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:49.263246 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2a25fb75-2a53-408a-b3ce-6e242c744ae0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:49.263858 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2a25fb75-2a53-408a-b3ce-6e242c744ae0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:49.266870 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-51a9c891-2c65-4c0c-a0f9-85a8eab9fa44 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:49.267324 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-51a9c891-2c65-4c0c-a0f9-85a8eab9fa44 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:49.268093 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-51a9c891-2c65-4c0c-a0f9-85a8eab9fa44 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:49.268559 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-51a9c891-2c65-4c0c-a0f9-85a8eab9fa44 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:49.271335 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2a25fb75-2a53-408a-b3ce-6e242c744ae0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:49.271828 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2a25fb75-2a53-408a-b3ce-6e242c744ae0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:49.272585 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2a25fb75-2a53-408a-b3ce-6e242c744ae0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:49.272997 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2a25fb75-2a53-408a-b3ce-6e242c744ae0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:49.473028 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-51a9c891-2c65-4c0c-a0f9-85a8eab9fa44 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:49.477865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2a25fb75-2a53-408a-b3ce-6e242c744ae0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:49.481094 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-51a9c891-2c65-4c0c-a0f9-85a8eab9fa44 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.225877 Jun 02 14:01:49.481877 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 358/738] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:49 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:49.485852 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2a25fb75-2a53-408a-b3ce-6e242c744ae0 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1521 microversion: 2.1 time: 0.226433 Jun 02 14:01:49.486430 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 381/739] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:49 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:49.831339 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c0ea703e-0769-4125-bcee-96a12ce893c0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:49.832071 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c0ea703e-0769-4125-bcee-96a12ce893c0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:49.838963 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c0ea703e-0769-4125-bcee-96a12ce893c0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:49.839427 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c0ea703e-0769-4125-bcee-96a12ce893c0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:49.840237 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c0ea703e-0769-4125-bcee-96a12ce893c0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:49.840693 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c0ea703e-0769-4125-bcee-96a12ce893c0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:49.977140 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c0ea703e-0769-4125-bcee-96a12ce893c0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:49.985740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c0ea703e-0769-4125-bcee-96a12ce893c0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:49.987230 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c0ea703e-0769-4125-bcee-96a12ce893c0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:49.988324 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c0ea703e-0769-4125-bcee-96a12ce893c0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1407 microversion: 2.20 time: 0.161164 Jun 02 14:01:49.988924 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 359/740] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:49 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:50.127597 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8c2d58b0-848f-4d43-b9d3-863c489871b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:50.128099 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8c2d58b0-848f-4d43-b9d3-863c489871b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:50.134046 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8c2d58b0-848f-4d43-b9d3-863c489871b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:50.134525 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8c2d58b0-848f-4d43-b9d3-863c489871b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:50.135283 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8c2d58b0-848f-4d43-b9d3-863c489871b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:50.135718 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8c2d58b0-848f-4d43-b9d3-863c489871b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:50.217201 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-8c2d58b0-848f-4d43-b9d3-863c489871b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lazy-loading 'services' on Instance uuid c714d190-39b3-40b8-a7d0-da49a06fe5fa {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:01:50.498822 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-dc3ade48-34f2-474d-87b2-726eb58eef16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:50.499374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-dc3ade48-34f2-474d-87b2-726eb58eef16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:50.506431 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dc3ade48-34f2-474d-87b2-726eb58eef16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:50.506885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dc3ade48-34f2-474d-87b2-726eb58eef16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:50.507703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dc3ade48-34f2-474d-87b2-726eb58eef16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:50.508142 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dc3ade48-34f2-474d-87b2-726eb58eef16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:50.559802 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8c2d58b0-848f-4d43-b9d3-863c489871b5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments/baa53ff6-3031-4592-9243-4bebe48b2efd" status: 202 len: 0 microversion: 2.1 time: 0.436066 Jun 02 14:01:50.560529 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 382/741] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 2 14:01:50 2022] DELETE /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments/baa53ff6-3031-4592-9243-4bebe48b2efd => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:01:50.565663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-670ec958-51b7-4e09-811b-3e20b4bb5953 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:50.566358 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-670ec958-51b7-4e09-811b-3e20b4bb5953 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:50.573516 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-670ec958-51b7-4e09-811b-3e20b4bb5953 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:50.573960 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-670ec958-51b7-4e09-811b-3e20b4bb5953 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:50.574716 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-670ec958-51b7-4e09-811b-3e20b4bb5953 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:50.575145 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-670ec958-51b7-4e09-811b-3e20b4bb5953 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:50.673117 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-dc3ade48-34f2-474d-87b2-726eb58eef16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:50.681109 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-dc3ade48-34f2-474d-87b2-726eb58eef16 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.186261 Jun 02 14:01:50.681673 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 360/742] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:50 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:50.698052 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7a3073ba-a819-40eb-bab0-46c2c647dfaa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:50.698052 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7a3073ba-a819-40eb-bab0-46c2c647dfaa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:50.698052 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7a3073ba-a819-40eb-bab0-46c2c647dfaa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:50.698052 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7a3073ba-a819-40eb-bab0-46c2c647dfaa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:50.698659 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7a3073ba-a819-40eb-bab0-46c2c647dfaa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:50.698659 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7a3073ba-a819-40eb-bab0-46c2c647dfaa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:50.726558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7a3073ba-a819-40eb-bab0-46c2c647dfaa tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043770 Jun 02 14:01:50.727120 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 361/743] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:01:50 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:01:50.739038 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-670ec958-51b7-4e09-811b-3e20b4bb5953 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:50.746802 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-670ec958-51b7-4e09-811b-3e20b4bb5953 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.185145 Jun 02 14:01:50.747357 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 383/744] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:50 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:51.006325 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-af6d9247-ea17-45da-9c89-8734a2b741df tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:51.006938 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-af6d9247-ea17-45da-9c89-8734a2b741df tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:51.013382 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-af6d9247-ea17-45da-9c89-8734a2b741df tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:51.013776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-af6d9247-ea17-45da-9c89-8734a2b741df tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:51.014535 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-af6d9247-ea17-45da-9c89-8734a2b741df tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:51.014972 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-af6d9247-ea17-45da-9c89-8734a2b741df tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:51.142219 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-af6d9247-ea17-45da-9c89-8734a2b741df tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:51.150177 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-af6d9247-ea17-45da-9c89-8734a2b741df tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:51.151699 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-af6d9247-ea17-45da-9c89-8734a2b741df tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:51.152830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-af6d9247-ea17-45da-9c89-8734a2b741df tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1407 microversion: 2.20 time: 0.150419 Jun 02 14:01:51.153383 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 362/745] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:51 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:51.698355 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b1fc6b1f-a809-4fb4-8cfc-2e82cb0ee8cb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:51.699183 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b1fc6b1f-a809-4fb4-8cfc-2e82cb0ee8cb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:51.706400 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b1fc6b1f-a809-4fb4-8cfc-2e82cb0ee8cb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:51.706941 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b1fc6b1f-a809-4fb4-8cfc-2e82cb0ee8cb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:51.707706 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b1fc6b1f-a809-4fb4-8cfc-2e82cb0ee8cb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:51.708136 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b1fc6b1f-a809-4fb4-8cfc-2e82cb0ee8cb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:51.726410 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:51.738969 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f96069fe-4187-438b-9272-c91bee08dfc1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:51.740537 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f96069fe-4187-438b-9272-c91bee08dfc1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:51.747073 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f96069fe-4187-438b-9272-c91bee08dfc1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:51.750452 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f96069fe-4187-438b-9272-c91bee08dfc1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:51.750452 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f96069fe-4187-438b-9272-c91bee08dfc1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:51.750452 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f96069fe-4187-438b-9272-c91bee08dfc1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:51.791761 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f96069fe-4187-438b-9272-c91bee08dfc1 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056103 Jun 02 14:01:51.795004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 363/746] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:01:51 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:01:51.800354 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7032344f-822c-403f-98d9-dd2e61efe5f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:51.801047 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7032344f-822c-403f-98d9-dd2e61efe5f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:51.807264 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7032344f-822c-403f-98d9-dd2e61efe5f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:51.807708 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7032344f-822c-403f-98d9-dd2e61efe5f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:51.808499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7032344f-822c-403f-98d9-dd2e61efe5f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:51.808931 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7032344f-822c-403f-98d9-dd2e61efe5f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:51.868536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b1fc6b1f-a809-4fb4-8cfc-2e82cb0ee8cb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:51.877643 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b1fc6b1f-a809-4fb4-8cfc-2e82cb0ee8cb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.183186 Jun 02 14:01:51.883879 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 384/747] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:51 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:51.889611 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-0247d7d0-4387-4b4b-944b-1d1de4f73104 req-f6bf2415-ba87-46f7-b6ef-09dd45d86884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96011da5-6967-44e1-af2c-2ad76c52da74", "name": "network-vif-plugged", "status": "completed", "tag": "ef61b669-91ec-4f6a-b126-1de24442c7c0"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:01:51.898138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-0247d7d0-4387-4b4b-944b-1d1de4f73104 req-f6bf2415-ba87-46f7-b6ef-09dd45d86884 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:51.898682 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-0247d7d0-4387-4b4b-944b-1d1de4f73104 req-f6bf2415-ba87-46f7-b6ef-09dd45d86884 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:51.911128 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-0247d7d0-4387-4b4b-944b-1d1de4f73104 req-f6bf2415-ba87-46f7-b6ef-09dd45d86884 service nova] Creating event network-vif-plugged:ef61b669-91ec-4f6a-b126-1de24442c7c0 for instance 96011da5-6967-44e1-af2c-2ad76c52da74 on hv-cinder-82651 Jun 02 14:01:51.916028 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-0247d7d0-4387-4b4b-944b-1d1de4f73104 req-f6bf2415-ba87-46f7-b6ef-09dd45d86884 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030608 Jun 02 14:01:51.916663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 385/748] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:01:51.964556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7032344f-822c-403f-98d9-dd2e61efe5f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:51.972829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7032344f-822c-403f-98d9-dd2e61efe5f2 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.176582 Jun 02 14:01:51.973401 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 364/749] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:51 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:52.172929 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-31db3b07-2338-40a0-a991-c76be0a9da16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:52.173551 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-31db3b07-2338-40a0-a991-c76be0a9da16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:52.179956 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-31db3b07-2338-40a0-a991-c76be0a9da16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:52.180454 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-31db3b07-2338-40a0-a991-c76be0a9da16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:52.181222 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-31db3b07-2338-40a0-a991-c76be0a9da16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:52.181650 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-31db3b07-2338-40a0-a991-c76be0a9da16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:52.319091 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-31db3b07-2338-40a0-a991-c76be0a9da16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:52.327784 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-31db3b07-2338-40a0-a991-c76be0a9da16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:52.329322 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-31db3b07-2338-40a0-a991-c76be0a9da16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:52.330439 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-31db3b07-2338-40a0-a991-c76be0a9da16 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1407 microversion: 2.20 time: 0.163132 Jun 02 14:01:52.330997 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 386/750] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:52 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:52.803666 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7c57f054-00b6-4d3e-9122-0be31944bfde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:52.804613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7c57f054-00b6-4d3e-9122-0be31944bfde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:52.811077 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7c57f054-00b6-4d3e-9122-0be31944bfde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:52.811517 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7c57f054-00b6-4d3e-9122-0be31944bfde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:52.812430 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7c57f054-00b6-4d3e-9122-0be31944bfde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:52.812866 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7c57f054-00b6-4d3e-9122-0be31944bfde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:52.843286 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7c57f054-00b6-4d3e-9122-0be31944bfde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043506 Jun 02 14:01:52.844378 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 365/751] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:01:52 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:01:52.895587 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ede56eeb-5b07-4f65-88a4-53cb13cd4368 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:52.896210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ede56eeb-5b07-4f65-88a4-53cb13cd4368 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:52.903409 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ede56eeb-5b07-4f65-88a4-53cb13cd4368 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:52.903946 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ede56eeb-5b07-4f65-88a4-53cb13cd4368 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:52.904987 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ede56eeb-5b07-4f65-88a4-53cb13cd4368 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:52.905526 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ede56eeb-5b07-4f65-88a4-53cb13cd4368 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:52.989627 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5bf405f3-d53f-4dbb-a952-587131bc1008 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:52.990155 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5bf405f3-d53f-4dbb-a952-587131bc1008 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:52.996381 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5bf405f3-d53f-4dbb-a952-587131bc1008 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:52.996940 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5bf405f3-d53f-4dbb-a952-587131bc1008 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:52.997782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5bf405f3-d53f-4dbb-a952-587131bc1008 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:52.998311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5bf405f3-d53f-4dbb-a952-587131bc1008 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:53.055719 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ede56eeb-5b07-4f65-88a4-53cb13cd4368 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:53.064012 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ede56eeb-5b07-4f65-88a4-53cb13cd4368 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.172498 Jun 02 14:01:53.064619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 387/752] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:52 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:53.142874 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5bf405f3-d53f-4dbb-a952-587131bc1008 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:53.150706 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5bf405f3-d53f-4dbb-a952-587131bc1008 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.165001 Jun 02 14:01:53.151268 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 366/753] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:52 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:53.347682 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0b9fbecf-9f65-4a0a-9047-51a579efc51e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:53.348215 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0b9fbecf-9f65-4a0a-9047-51a579efc51e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:53.354309 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0b9fbecf-9f65-4a0a-9047-51a579efc51e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:53.354755 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0b9fbecf-9f65-4a0a-9047-51a579efc51e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:53.355508 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0b9fbecf-9f65-4a0a-9047-51a579efc51e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:53.355938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0b9fbecf-9f65-4a0a-9047-51a579efc51e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:53.489128 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0b9fbecf-9f65-4a0a-9047-51a579efc51e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:53.497406 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0b9fbecf-9f65-4a0a-9047-51a579efc51e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:53.498925 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0b9fbecf-9f65-4a0a-9047-51a579efc51e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:53.500771 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0b9fbecf-9f65-4a0a-9047-51a579efc51e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1407 microversion: 2.20 time: 0.157102 Jun 02 14:01:53.501331 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 388/754] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:53 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:53.855190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-abab7bdd-7bdd-4d93-8a3b-3c31e3c1a274 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:53.856112 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-abab7bdd-7bdd-4d93-8a3b-3c31e3c1a274 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:53.862709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-abab7bdd-7bdd-4d93-8a3b-3c31e3c1a274 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:53.863158 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-abab7bdd-7bdd-4d93-8a3b-3c31e3c1a274 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:53.863917 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-abab7bdd-7bdd-4d93-8a3b-3c31e3c1a274 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:53.864348 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-abab7bdd-7bdd-4d93-8a3b-3c31e3c1a274 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:53.893803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-abab7bdd-7bdd-4d93-8a3b-3c31e3c1a274 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042540 Jun 02 14:01:53.894347 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 367/755] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:01:53 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:01:54.082317 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-aaa6743d-16a1-49e7-be08-8c28781e5223 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:54.082948 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-aaa6743d-16a1-49e7-be08-8c28781e5223 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:54.089320 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aaa6743d-16a1-49e7-be08-8c28781e5223 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:54.089767 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aaa6743d-16a1-49e7-be08-8c28781e5223 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:54.090521 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aaa6743d-16a1-49e7-be08-8c28781e5223 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:54.090956 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aaa6743d-16a1-49e7-be08-8c28781e5223 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:54.167260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-8fd15eb2-212e-437a-9fef-a58877d37c72 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:54.168163 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-8fd15eb2-212e-437a-9fef-a58877d37c72 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:54.175590 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8fd15eb2-212e-437a-9fef-a58877d37c72 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:54.176037 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8fd15eb2-212e-437a-9fef-a58877d37c72 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:54.176835 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8fd15eb2-212e-437a-9fef-a58877d37c72 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:54.177268 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8fd15eb2-212e-437a-9fef-a58877d37c72 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:54.256830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-aaa6743d-16a1-49e7-be08-8c28781e5223 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:54.267753 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-aaa6743d-16a1-49e7-be08-8c28781e5223 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.190047 Jun 02 14:01:54.273893 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 389/756] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:54 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:54.278658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-c12c9314-f8df-4a77-991e-fe0c00f65aaa req-8d1276f8-df77-4265-9e66-372ab233b966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d778df4-cdc9-440b-acda-4b10357cb31f", "name": "network-vif-plugged", "status": "completed", "tag": "1bbbd139-07e3-43f6-afa9-e2d8b6eb9d5e"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:01:54.286831 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-c12c9314-f8df-4a77-991e-fe0c00f65aaa req-8d1276f8-df77-4265-9e66-372ab233b966 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:54.287273 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-c12c9314-f8df-4a77-991e-fe0c00f65aaa req-8d1276f8-df77-4265-9e66-372ab233b966 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:54.301261 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-c12c9314-f8df-4a77-991e-fe0c00f65aaa req-8d1276f8-df77-4265-9e66-372ab233b966 service nova] Creating event network-vif-plugged:1bbbd139-07e3-43f6-afa9-e2d8b6eb9d5e for instance 6d778df4-cdc9-440b-acda-4b10357cb31f on hv-cinder-82651 Jun 02 14:01:54.306314 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-c12c9314-f8df-4a77-991e-fe0c00f65aaa req-8d1276f8-df77-4265-9e66-372ab233b966 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036398 Jun 02 14:01:54.306912 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 390/757] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:01:54.329377 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-8fd15eb2-212e-437a-9fef-a58877d37c72 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:54.336853 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-8fd15eb2-212e-437a-9fef-a58877d37c72 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.173434 Jun 02 14:01:54.337489 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 368/758] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:54 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:54.520683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6a525e7f-bb87-4f63-9828-2b84bb6ec5e2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:54.520683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6a525e7f-bb87-4f63-9828-2b84bb6ec5e2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:54.526263 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6a525e7f-bb87-4f63-9828-2b84bb6ec5e2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:54.526704 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6a525e7f-bb87-4f63-9828-2b84bb6ec5e2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:54.527444 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6a525e7f-bb87-4f63-9828-2b84bb6ec5e2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:54.527868 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6a525e7f-bb87-4f63-9828-2b84bb6ec5e2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:54.657748 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6a525e7f-bb87-4f63-9828-2b84bb6ec5e2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:54.666093 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6a525e7f-bb87-4f63-9828-2b84bb6ec5e2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:54.667633 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6a525e7f-bb87-4f63-9828-2b84bb6ec5e2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:54.668761 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6a525e7f-bb87-4f63-9828-2b84bb6ec5e2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1407 microversion: 2.20 time: 0.153573 Jun 02 14:01:54.669314 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 391/759] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:54 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:54.908176 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b12f3671-17f6-4175-b11c-a9b98fbde6c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:54.909831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b12f3671-17f6-4175-b11c-a9b98fbde6c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:54.916880 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b12f3671-17f6-4175-b11c-a9b98fbde6c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:54.917327 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b12f3671-17f6-4175-b11c-a9b98fbde6c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:54.918215 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b12f3671-17f6-4175-b11c-a9b98fbde6c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:54.918678 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b12f3671-17f6-4175-b11c-a9b98fbde6c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:54.950813 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b12f3671-17f6-4175-b11c-a9b98fbde6c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048176 Jun 02 14:01:54.951399 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 369/760] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:01:54 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 14:01:55.041088 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-33d10f2b-e3e4-4298-a6c7-11c6b27aa4f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:55.042791 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-33d10f2b-e3e4-4298-a6c7-11c6b27aa4f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:55.049081 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-33d10f2b-e3e4-4298-a6c7-11c6b27aa4f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:55.051008 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-33d10f2b-e3e4-4298-a6c7-11c6b27aa4f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:55.051008 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-33d10f2b-e3e4-4298-a6c7-11c6b27aa4f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:55.051008 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-33d10f2b-e3e4-4298-a6c7-11c6b27aa4f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:55.076095 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-33d10f2b-e3e4-4298-a6c7-11c6b27aa4f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Going to try to terminate instance {{(pid=118316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:01:55.285837 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-95ebd99e-485c-4427-80df-07ec58414f4d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:55.287400 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-95ebd99e-485c-4427-80df-07ec58414f4d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:55.293630 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-95ebd99e-485c-4427-80df-07ec58414f4d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:55.294030 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-95ebd99e-485c-4427-80df-07ec58414f4d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:55.294795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-95ebd99e-485c-4427-80df-07ec58414f4d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:55.295229 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-95ebd99e-485c-4427-80df-07ec58414f4d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:55.427543 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-95ebd99e-485c-4427-80df-07ec58414f4d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:55.434162 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-33d10f2b-e3e4-4298-a6c7-11c6b27aa4f9 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 204 len: 0 microversion: 2.1 time: 0.396784 Jun 02 14:01:55.434862 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 392/761] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:01:55 2022] DELETE /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:01:55.435147 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-95ebd99e-485c-4427-80df-07ec58414f4d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.154092 Jun 02 14:01:55.435702 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 370/762] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:55 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:55.440920 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d0b7e1ac-dfbf-45ee-b68a-852709ca38fa tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:55.444012 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d0b7e1ac-dfbf-45ee-b68a-852709ca38fa tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:55.444171 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1c62cd47-0625-44b9-8c6b-7fdc7fc83230 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:55.444171 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1c62cd47-0625-44b9-8c6b-7fdc7fc83230 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:55.447927 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d0b7e1ac-dfbf-45ee-b68a-852709ca38fa tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:55.448389 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d0b7e1ac-dfbf-45ee-b68a-852709ca38fa tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:55.449168 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d0b7e1ac-dfbf-45ee-b68a-852709ca38fa tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:55.449602 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d0b7e1ac-dfbf-45ee-b68a-852709ca38fa tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:55.459295 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1c62cd47-0625-44b9-8c6b-7fdc7fc83230 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:55.459737 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1c62cd47-0625-44b9-8c6b-7fdc7fc83230 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:55.460546 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1c62cd47-0625-44b9-8c6b-7fdc7fc83230 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:55.460977 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1c62cd47-0625-44b9-8c6b-7fdc7fc83230 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:55.652189 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d0b7e1ac-dfbf-45ee-b68a-852709ca38fa tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:55.655486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1c62cd47-0625-44b9-8c6b-7fdc7fc83230 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:55.659892 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d0b7e1ac-dfbf-45ee-b68a-852709ca38fa tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.223813 Jun 02 14:01:55.660575 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 393/763] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:55 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:55.663587 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1c62cd47-0625-44b9-8c6b-7fdc7fc83230 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1686 microversion: 2.1 time: 0.223870 Jun 02 14:01:55.664147 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 371/764] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:55 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1686 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:55.688785 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-39f1c900-05d5-490d-b055-6296977f51b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:55.689397 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-39f1c900-05d5-490d-b055-6296977f51b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:55.695422 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-39f1c900-05d5-490d-b055-6296977f51b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:55.695873 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-39f1c900-05d5-490d-b055-6296977f51b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:55.696664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-39f1c900-05d5-490d-b055-6296977f51b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:55.697103 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-39f1c900-05d5-490d-b055-6296977f51b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:55.827527 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-39f1c900-05d5-490d-b055-6296977f51b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:55.835939 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-39f1c900-05d5-490d-b055-6296977f51b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:55.837485 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-39f1c900-05d5-490d-b055-6296977f51b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:55.838686 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-39f1c900-05d5-490d-b055-6296977f51b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1599 microversion: 2.20 time: 0.154637 Jun 02 14:01:55.839249 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 394/765] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:01:55 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:01:55.856366 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fbb295dc-cdc4-4d9b-bf5a-56c4333182c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:55.856906 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-fbb295dc-cdc4-4d9b-bf5a-56c4333182c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:55.863503 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fbb295dc-cdc4-4d9b-bf5a-56c4333182c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:55.863948 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fbb295dc-cdc4-4d9b-bf5a-56c4333182c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:55.864738 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fbb295dc-cdc4-4d9b-bf5a-56c4333182c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:55.865174 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fbb295dc-cdc4-4d9b-bf5a-56c4333182c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:55.947623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-fbb295dc-cdc4-4d9b-bf5a-56c4333182c4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093465 Jun 02 14:01:55.947623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 372/766] 10.222.0.33 () {60 vars in 1315 bytes} [Thu Jun 2 14:01:55 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 14:01:56.459757 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-52229f0d-22d7-4ca4-987b-ac76a34e0d56 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:56.460370 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-52229f0d-22d7-4ca4-987b-ac76a34e0d56 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:56.466822 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-52229f0d-22d7-4ca4-987b-ac76a34e0d56 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:56.467269 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-52229f0d-22d7-4ca4-987b-ac76a34e0d56 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:56.468025 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-52229f0d-22d7-4ca4-987b-ac76a34e0d56 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:56.469252 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-52229f0d-22d7-4ca4-987b-ac76a34e0d56 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:56.677321 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-60a7a9dd-bbdc-40f8-9774-660c5fa6c181 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:56.677845 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-60a7a9dd-bbdc-40f8-9774-660c5fa6c181 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:56.684136 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-60a7a9dd-bbdc-40f8-9774-660c5fa6c181 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:56.684620 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-60a7a9dd-bbdc-40f8-9774-660c5fa6c181 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:56.685399 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-60a7a9dd-bbdc-40f8-9774-660c5fa6c181 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:56.685837 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-60a7a9dd-bbdc-40f8-9774-660c5fa6c181 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:56.689943 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=100 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:56.768065 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-52229f0d-22d7-4ca4-987b-ac76a34e0d56 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:56.775616 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-52229f0d-22d7-4ca4-987b-ac76a34e0d56 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.319777 Jun 02 14:01:56.776279 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 395/767] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:56 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:56.789562 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6866312d-e27b-4e90-acd3-b366b2ab4c45 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:56.790175 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6866312d-e27b-4e90-acd3-b366b2ab4c45 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:56.796098 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6866312d-e27b-4e90-acd3-b366b2ab4c45 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:56.796561 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6866312d-e27b-4e90-acd3-b366b2ab4c45 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:56.797535 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6866312d-e27b-4e90-acd3-b366b2ab4c45 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:56.797968 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6866312d-e27b-4e90-acd3-b366b2ab4c45 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:57.144582 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-60a7a9dd-bbdc-40f8-9774-660c5fa6c181 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:57.153305 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-60a7a9dd-bbdc-40f8-9774-660c5fa6c181 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.479895 Jun 02 14:01:57.162761 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 373/768] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:56 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:57.237771 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6866312d-e27b-4e90-acd3-b366b2ab4c45 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:57.245254 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6866312d-e27b-4e90-acd3-b366b2ab4c45 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1686 microversion: 2.1 time: 0.459398 Jun 02 14:01:57.245840 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 396/769] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:56 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1686 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:57.381235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-f2bb3d85-b1ba-4c30-bd75-5259b5db8f8e req-ef38f846-ebdd-4265-a160-b6aa9fdaf421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96011da5-6967-44e1-af2c-2ad76c52da74", "tag": "ef61b669-91ec-4f6a-b126-1de24442c7c0"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:01:57.389343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-f2bb3d85-b1ba-4c30-bd75-5259b5db8f8e req-ef38f846-ebdd-4265-a160-b6aa9fdaf421 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:57.389795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-f2bb3d85-b1ba-4c30-bd75-5259b5db8f8e req-ef38f846-ebdd-4265-a160-b6aa9fdaf421 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:57.401482 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-f2bb3d85-b1ba-4c30-bd75-5259b5db8f8e req-ef38f846-ebdd-4265-a160-b6aa9fdaf421 service nova] Creating event network-changed:ef61b669-91ec-4f6a-b126-1de24442c7c0 for instance 96011da5-6967-44e1-af2c-2ad76c52da74 on hv-cinder-82651 Jun 02 14:01:57.406575 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-f2bb3d85-b1ba-4c30-bd75-5259b5db8f8e req-ef38f846-ebdd-4265-a160-b6aa9fdaf421 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029003 Jun 02 14:01:57.407154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 374/770] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:01:57.792640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-93125b75-4d55-4717-8150-f42a9211f220 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:57.793255 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-93125b75-4d55-4717-8150-f42a9211f220 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:57.800325 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-93125b75-4d55-4717-8150-f42a9211f220 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:57.800804 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-93125b75-4d55-4717-8150-f42a9211f220 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:57.801582 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-93125b75-4d55-4717-8150-f42a9211f220 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:57.802037 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-93125b75-4d55-4717-8150-f42a9211f220 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:57.935027 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-93125b75-4d55-4717-8150-f42a9211f220 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:57.942745 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-93125b75-4d55-4717-8150-f42a9211f220 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.154040 Jun 02 14:01:57.943317 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 397/771] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:57 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:58.171228 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-dee6b43f-3981-42c2-a29b-0007e821eca7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:58.172134 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-dee6b43f-3981-42c2-a29b-0007e821eca7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:58.178511 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dee6b43f-3981-42c2-a29b-0007e821eca7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:58.178963 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dee6b43f-3981-42c2-a29b-0007e821eca7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:58.179734 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dee6b43f-3981-42c2-a29b-0007e821eca7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:58.180173 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dee6b43f-3981-42c2-a29b-0007e821eca7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:58.266565 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f6b8ed76-8ba9-4491-83b6-544443c4f2b2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:58.266565 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f6b8ed76-8ba9-4491-83b6-544443c4f2b2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:58.272706 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f6b8ed76-8ba9-4491-83b6-544443c4f2b2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:58.273152 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f6b8ed76-8ba9-4491-83b6-544443c4f2b2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:58.273913 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f6b8ed76-8ba9-4491-83b6-544443c4f2b2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:58.274352 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f6b8ed76-8ba9-4491-83b6-544443c4f2b2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:58.353498 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-dee6b43f-3981-42c2-a29b-0007e821eca7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:58.362417 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-dee6b43f-3981-42c2-a29b-0007e821eca7 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.195891 Jun 02 14:01:58.368771 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 375/772] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:58 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:58.423076 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f6b8ed76-8ba9-4491-83b6-544443c4f2b2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:58.430880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f6b8ed76-8ba9-4491-83b6-544443c4f2b2 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1686 microversion: 2.1 time: 0.169541 Jun 02 14:01:58.431541 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 398/773] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:58 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:01:58.960247 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-14577df2-ea2b-46b9-b011-807008a7fea1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:58.960887 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-14577df2-ea2b-46b9-b011-807008a7fea1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:58.966967 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-14577df2-ea2b-46b9-b011-807008a7fea1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:58.967417 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-14577df2-ea2b-46b9-b011-807008a7fea1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:58.968825 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-14577df2-ea2b-46b9-b011-807008a7fea1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:58.969266 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-14577df2-ea2b-46b9-b011-807008a7fea1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:59.103891 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-14577df2-ea2b-46b9-b011-807008a7fea1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:59.111819 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-14577df2-ea2b-46b9-b011-807008a7fea1 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.155678 Jun 02 14:01:59.112381 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 376/774] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:58 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:59.381568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c19bdfd1-ecd9-45a0-b39a-fad07f066d8d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:59.382248 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c19bdfd1-ecd9-45a0-b39a-fad07f066d8d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:59.385778 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:59.389362 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c19bdfd1-ecd9-45a0-b39a-fad07f066d8d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:59.403243 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c19bdfd1-ecd9-45a0-b39a-fad07f066d8d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:59.403243 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c19bdfd1-ecd9-45a0-b39a-fad07f066d8d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:59.403243 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c19bdfd1-ecd9-45a0-b39a-fad07f066d8d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:59.448628 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-68c6913d-cde4-4880-bf28-a05752fd7f99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:01:59.449268 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-68c6913d-cde4-4880-bf28-a05752fd7f99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:01:59.455714 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-68c6913d-cde4-4880-bf28-a05752fd7f99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:59.456168 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-68c6913d-cde4-4880-bf28-a05752fd7f99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:59.456971 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-68c6913d-cde4-4880-bf28-a05752fd7f99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:01:59.457399 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-68c6913d-cde4-4880-bf28-a05752fd7f99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:01:59.565675 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c19bdfd1-ecd9-45a0-b39a-fad07f066d8d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:59.573605 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c19bdfd1-ecd9-45a0-b39a-fad07f066d8d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.196024 Jun 02 14:01:59.574173 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 399/775] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:59 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:01:59.612180 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-68c6913d-cde4-4880-bf28-a05752fd7f99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:01:59.619689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-68c6913d-cde4-4880-bf28-a05752fd7f99 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1686 microversion: 2.1 time: 0.175220 Jun 02 14:01:59.620283 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 377/776] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:01:59 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1686 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:00.127775 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d095b7ae-1a0e-4f19-9b10-7652a051c21e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:00.128386 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d095b7ae-1a0e-4f19-9b10-7652a051c21e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:00.134471 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d095b7ae-1a0e-4f19-9b10-7652a051c21e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:00.134922 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d095b7ae-1a0e-4f19-9b10-7652a051c21e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:00.135674 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d095b7ae-1a0e-4f19-9b10-7652a051c21e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:00.136115 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d095b7ae-1a0e-4f19-9b10-7652a051c21e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:00.268666 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d095b7ae-1a0e-4f19-9b10-7652a051c21e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:00.272079 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:00.276396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d095b7ae-1a0e-4f19-9b10-7652a051c21e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.152578 Jun 02 14:02:00.277631 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 400/777] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:00 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:00.590995 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7deb0e58-b459-4302-9189-d51123207036 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:00.591609 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7deb0e58-b459-4302-9189-d51123207036 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:00.598160 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7deb0e58-b459-4302-9189-d51123207036 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:00.598613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7deb0e58-b459-4302-9189-d51123207036 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:00.599371 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7deb0e58-b459-4302-9189-d51123207036 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:00.599807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7deb0e58-b459-4302-9189-d51123207036 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:00.639844 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d6dcfed4-2eac-4d09-a467-e6d82da1d67b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:00.641561 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d6dcfed4-2eac-4d09-a467-e6d82da1d67b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:00.649718 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6dcfed4-2eac-4d09-a467-e6d82da1d67b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:00.650091 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6dcfed4-2eac-4d09-a467-e6d82da1d67b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:00.651681 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6dcfed4-2eac-4d09-a467-e6d82da1d67b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:00.652364 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6dcfed4-2eac-4d09-a467-e6d82da1d67b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:00.795769 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7deb0e58-b459-4302-9189-d51123207036 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:00.803741 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7deb0e58-b459-4302-9189-d51123207036 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.216641 Jun 02 14:02:00.804312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 378/778] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:00 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:00.821841 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d6dcfed4-2eac-4d09-a467-e6d82da1d67b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:00.830283 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d6dcfed4-2eac-4d09-a467-e6d82da1d67b tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1686 microversion: 2.1 time: 0.195211 Jun 02 14:02:00.830918 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 401/779] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:00 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1686 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:01.296130 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-6146dd64-ec6b-41bb-94fd-192843900e84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:01.297470 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-6146dd64-ec6b-41bb-94fd-192843900e84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:01.303357 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6146dd64-ec6b-41bb-94fd-192843900e84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:01.303798 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6146dd64-ec6b-41bb-94fd-192843900e84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:01.304572 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6146dd64-ec6b-41bb-94fd-192843900e84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:01.305003 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-6146dd64-ec6b-41bb-94fd-192843900e84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:01.434800 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-6146dd64-ec6b-41bb-94fd-192843900e84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:01.442385 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-6146dd64-ec6b-41bb-94fd-192843900e84 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.150042 Jun 02 14:02:01.442947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 379/780] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:01 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:01.821475 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2ae79f12-5ec6-4968-a639-6af84898f0f5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:01.823056 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2ae79f12-5ec6-4968-a639-6af84898f0f5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:01.829886 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2ae79f12-5ec6-4968-a639-6af84898f0f5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:01.830342 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2ae79f12-5ec6-4968-a639-6af84898f0f5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:01.831116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2ae79f12-5ec6-4968-a639-6af84898f0f5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:01.831573 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2ae79f12-5ec6-4968-a639-6af84898f0f5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:01.847955 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3c6bd3d3-bb05-49c6-b6c9-5b89347b77e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:01.859756 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3c6bd3d3-bb05-49c6-b6c9-5b89347b77e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:01.859756 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3c6bd3d3-bb05-49c6-b6c9-5b89347b77e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:01.859756 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3c6bd3d3-bb05-49c6-b6c9-5b89347b77e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:01.859756 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3c6bd3d3-bb05-49c6-b6c9-5b89347b77e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:01.860339 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3c6bd3d3-bb05-49c6-b6c9-5b89347b77e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:02.032142 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2ae79f12-5ec6-4968-a639-6af84898f0f5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:02.035329 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3c6bd3d3-bb05-49c6-b6c9-5b89347b77e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:02.039583 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2ae79f12-5ec6-4968-a639-6af84898f0f5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.222122 Jun 02 14:02:02.040164 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 402/781] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:01 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:02.042977 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3c6bd3d3-bb05-49c6-b6c9-5b89347b77e3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1686 microversion: 2.1 time: 0.199767 Jun 02 14:02:02.043534 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 380/782] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:01 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1686 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:02.459676 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-eb5238e1-6f87-43a5-ad54-e7041443f739 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:02.460367 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-eb5238e1-6f87-43a5-ad54-e7041443f739 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:02.466640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eb5238e1-6f87-43a5-ad54-e7041443f739 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:02.467077 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eb5238e1-6f87-43a5-ad54-e7041443f739 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:02.467825 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eb5238e1-6f87-43a5-ad54-e7041443f739 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:02.468431 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eb5238e1-6f87-43a5-ad54-e7041443f739 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:02.602985 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-eb5238e1-6f87-43a5-ad54-e7041443f739 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:02.611091 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-eb5238e1-6f87-43a5-ad54-e7041443f739 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.155322 Jun 02 14:02:02.614052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 403/783] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:02 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:03.056723 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0180fff0-efe7-4b48-8305-27e152443a5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:03.057253 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0180fff0-efe7-4b48-8305-27e152443a5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:03.058660 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-66e89d56-f7e2-4a2d-b992-1e7f607fe36d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:03.059274 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-66e89d56-f7e2-4a2d-b992-1e7f607fe36d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:03.064062 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0180fff0-efe7-4b48-8305-27e152443a5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:03.064533 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0180fff0-efe7-4b48-8305-27e152443a5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:03.065288 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0180fff0-efe7-4b48-8305-27e152443a5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:03.065713 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0180fff0-efe7-4b48-8305-27e152443a5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:03.066111 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-66e89d56-f7e2-4a2d-b992-1e7f607fe36d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:03.066566 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-66e89d56-f7e2-4a2d-b992-1e7f607fe36d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:03.067330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-66e89d56-f7e2-4a2d-b992-1e7f607fe36d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:03.067768 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-66e89d56-f7e2-4a2d-b992-1e7f607fe36d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:03.262787 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0180fff0-efe7-4b48-8305-27e152443a5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:03.267418 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-66e89d56-f7e2-4a2d-b992-1e7f607fe36d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:03.275058 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0180fff0-efe7-4b48-8305-27e152443a5b tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.222285 Jun 02 14:02:03.279405 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-66e89d56-f7e2-4a2d-b992-1e7f607fe36d tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1686 microversion: 2.1 time: 0.224505 Jun 02 14:02:03.279995 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 404/784] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:03 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1686 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:03.290488 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 381/785] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:03 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:03.629686 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-eb3d9490-cbcd-4e99-ae75-5efa60ad58b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:03.630503 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-eb3d9490-cbcd-4e99-ae75-5efa60ad58b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:03.637749 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eb3d9490-cbcd-4e99-ae75-5efa60ad58b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:03.642844 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eb3d9490-cbcd-4e99-ae75-5efa60ad58b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:03.642844 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eb3d9490-cbcd-4e99-ae75-5efa60ad58b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:03.642844 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eb3d9490-cbcd-4e99-ae75-5efa60ad58b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:03.775872 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-eb3d9490-cbcd-4e99-ae75-5efa60ad58b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:03.783664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-eb3d9490-cbcd-4e99-ae75-5efa60ad58b0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1266 microversion: 2.1 time: 0.159661 Jun 02 14:02:03.784238 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 405/786] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:03 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:04.303490 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-98d8f150-ed5b-46cc-861a-60062d1771d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:04.304252 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-98d8f150-ed5b-46cc-861a-60062d1771d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:04.305851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-972d5155-a3c2-4bd2-a3ec-fd2bcf9c1b70 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:04.307619 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-972d5155-a3c2-4bd2-a3ec-fd2bcf9c1b70 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:04.320183 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-98d8f150-ed5b-46cc-861a-60062d1771d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:04.322085 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-972d5155-a3c2-4bd2-a3ec-fd2bcf9c1b70 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:04.322888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-98d8f150-ed5b-46cc-861a-60062d1771d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:04.323951 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-98d8f150-ed5b-46cc-861a-60062d1771d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:04.324392 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-98d8f150-ed5b-46cc-861a-60062d1771d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:04.328899 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-972d5155-a3c2-4bd2-a3ec-fd2bcf9c1b70 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:04.330309 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-972d5155-a3c2-4bd2-a3ec-fd2bcf9c1b70 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:04.330752 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-972d5155-a3c2-4bd2-a3ec-fd2bcf9c1b70 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:04.452510 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-98d8f150-ed5b-46cc-861a-60062d1771d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:04.460705 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-98d8f150-ed5b-46cc-861a-60062d1771d3 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1620 microversion: 2.1 time: 0.161623 Jun 02 14:02:04.471590 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 406/787] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:04 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1620 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:04.476352 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-7e61d8ea-8ed0-464c-8456-77f9e7778d25 req-263035e2-6027-49c6-9c0f-07655458f89d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c714d190-39b3-40b8-a7d0-da49a06fe5fa", "name": "network-vif-deleted", "tag": "49169967-d46d-4a7e-b861-a60a2de510d4"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:04.493009 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-7e61d8ea-8ed0-464c-8456-77f9e7778d25 req-263035e2-6027-49c6-9c0f-07655458f89d service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:04.493477 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-7e61d8ea-8ed0-464c-8456-77f9e7778d25 req-263035e2-6027-49c6-9c0f-07655458f89d service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:04.546588 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-7e61d8ea-8ed0-464c-8456-77f9e7778d25 req-263035e2-6027-49c6-9c0f-07655458f89d service nova] Creating event network-vif-deleted:49169967-d46d-4a7e-b861-a60a2de510d4 for instance c714d190-39b3-40b8-a7d0-da49a06fe5fa on hv-cinder-82651 Jun 02 14:02:04.549483 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-972d5155-a3c2-4bd2-a3ec-fd2bcf9c1b70 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:04.557315 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-972d5155-a3c2-4bd2-a3ec-fd2bcf9c1b70 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.262833 Jun 02 14:02:04.567938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-7e61d8ea-8ed0-464c-8456-77f9e7778d25 req-263035e2-6027-49c6-9c0f-07655458f89d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088111 Jun 02 14:02:04.567938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 407/788] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:04.569556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 382/789] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:04 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:04.801393 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f76e6e07-c442-4f6a-b209-119c3c56c09a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:04.802093 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f76e6e07-c442-4f6a-b209-119c3c56c09a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:04.815340 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f76e6e07-c442-4f6a-b209-119c3c56c09a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:04.815951 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f76e6e07-c442-4f6a-b209-119c3c56c09a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:04.817679 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f76e6e07-c442-4f6a-b209-119c3c56c09a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:04.818558 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f76e6e07-c442-4f6a-b209-119c3c56c09a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:04.965673 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f76e6e07-c442-4f6a-b209-119c3c56c09a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:04.975133 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f76e6e07-c442-4f6a-b209-119c3c56c09a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1452 microversion: 2.1 time: 0.177933 Jun 02 14:02:04.975658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 408/790] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:04 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:04.992933 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f5299b77-3118-4f6d-8510-4dedba98b63d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:04.993548 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f5299b77-3118-4f6d-8510-4dedba98b63d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:05.004096 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f5299b77-3118-4f6d-8510-4dedba98b63d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:05.004599 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f5299b77-3118-4f6d-8510-4dedba98b63d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:05.005384 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f5299b77-3118-4f6d-8510-4dedba98b63d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:05.005872 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f5299b77-3118-4f6d-8510-4dedba98b63d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:05.146350 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f5299b77-3118-4f6d-8510-4dedba98b63d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:05.153836 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f5299b77-3118-4f6d-8510-4dedba98b63d tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1452 microversion: 2.1 time: 0.165997 Jun 02 14:02:05.154392 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 383/791] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:04 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:05.478495 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ceb6cb25-8a39-4973-9de8-89d06ceca397 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:05.485945 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ceb6cb25-8a39-4973-9de8-89d06ceca397 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:05.494061 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ceb6cb25-8a39-4973-9de8-89d06ceca397 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:05.494518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ceb6cb25-8a39-4973-9de8-89d06ceca397 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:05.505985 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ceb6cb25-8a39-4973-9de8-89d06ceca397 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:05.506439 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ceb6cb25-8a39-4973-9de8-89d06ceca397 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:05.554381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ceb6cb25-8a39-4973-9de8-89d06ceca397 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:05.554988 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ceb6cb25-8a39-4973-9de8-89d06ceca397 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:05.555563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-ceb6cb25-8a39-4973-9de8-89d06ceca397 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lazy-loading 'fault' on Instance uuid c714d190-39b3-40b8-a7d0-da49a06fe5fa {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:02:05.577385 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7a37c090-51e5-4796-9c16-407f3d6d36ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:05.578560 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7a37c090-51e5-4796-9c16-407f3d6d36ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:05.589296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7a37c090-51e5-4796-9c16-407f3d6d36ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:05.590080 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7a37c090-51e5-4796-9c16-407f3d6d36ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:05.591031 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7a37c090-51e5-4796-9c16-407f3d6d36ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:05.591680 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7a37c090-51e5-4796-9c16-407f3d6d36ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:05.613155 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ceb6cb25-8a39-4973-9de8-89d06ceca397 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:05.637365 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ceb6cb25-8a39-4973-9de8-89d06ceca397 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 200 len: 1334 microversion: 2.1 time: 0.152216 Jun 02 14:02:05.648187 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 409/792] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:05 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 1334 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:05.845137 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7a37c090-51e5-4796-9c16-407f3d6d36ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:05.853767 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7a37c090-51e5-4796-9c16-407f3d6d36ad tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.281330 Jun 02 14:02:05.854349 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 384/793] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:05 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:06.655275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2db797d7-fc9c-48f4-8a93-fd63734bd47c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:06.655860 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2db797d7-fc9c-48f4-8a93-fd63734bd47c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: c714d190-39b3-40b8-a7d0-da49a06fe5fa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:06.663354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2db797d7-fc9c-48f4-8a93-fd63734bd47c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:06.663792 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2db797d7-fc9c-48f4-8a93-fd63734bd47c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:06.664583 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2db797d7-fc9c-48f4-8a93-fd63734bd47c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:06.665019 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2db797d7-fc9c-48f4-8a93-fd63734bd47c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:06.680102 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-2db797d7-fc9c-48f4-8a93-fd63734bd47c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] HTTP exception thrown: Instance c714d190-39b3-40b8-a7d0-da49a06fe5fa could not be found. Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2db797d7-fc9c-48f4-8a93-fd63734bd47c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Request method failure captured: Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa HTTP/1.1 Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMD8es0jslrTw9H8zr0XMa1qVV_2yPyM188swiKF6vue0UYQNpH_rsvPjYaA-2ztdEbY44YK_QxUDWq9XJNDE3-Kz8Vz5C4hu7UZU9-dLcdNvHGNma-2ZrgZ_BK-9VNICseKjoeXmiFPmRH8MNBMa_-WjWv-iCJzdGCPmtouVpcN-84 Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: b067e3c448e24f179830992fecf65399 Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:02:06.681770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:02:06.683520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b067e3c448e24f179830992fecf65399"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b067e3c448e24f179830992fecf65399"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b067e3c448e24f179830992fecf65399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b067e3c448e24f179830992fecf65399"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:02:06.683520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 14:02:06.683520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: b067e3c448e24f179830992fecf65399 Jun 02 14:02:06.683520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 14:02:06.683520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-ServerRescueNegativeTestJSON-1754502689-project Jun 02 14:02:06.683520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:02:06.683520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:02:06.683520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: f9e57606c14a4ad99612414c1f9719f4 Jun 02 14:02:06.683520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1754502689-project Jun 02 14:02:06.683520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:02:06.683520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance c714d190-39b3-40b8-a7d0-da49a06fe5fa could not be found. Jun 02 14:02:06.683520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': 'c714d190-39b3-40b8-a7d0-da49a06fe5fa'} Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c714d190-39b3-40b8-a7d0-da49a06fe5fa could not be found. Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:02:06.684354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c714d190-39b3-40b8-a7d0-da49a06fe5fa could not be found. Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c714d190-39b3-40b8-a7d0-da49a06fe5fa could not be found. Jun 02 14:02:06.690654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:02:06.691865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2db797d7-fc9c-48f4-8a93-fd63734bd47c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Returning 404 to user: Instance c714d190-39b3-40b8-a7d0-da49a06fe5fa could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:02:06.691865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2db797d7-fc9c-48f4-8a93-fd63734bd47c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa" status: 404 len: 111 microversion: 2.1 time: 0.031872 Jun 02 14:02:06.691865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 410/794] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:06 2022] GET /compute/v2.1/servers/c714d190-39b3-40b8-a7d0-da49a06fe5fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:02:06.692083 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f22809c4-5e2c-4586-8595-8e9cf9e55541 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '.version_select at 0x7fb71aeb40d0>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:06.783940 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f22809c4-5e2c-4586-8595-8e9cf9e55541 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-636255136" status: 202 len: 0 microversion: 2.1 time: 0.095788 Jun 02 14:02:06.784565 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 385/795] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 2 14:02:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-636255136 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:02:06.871388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c9e30765-af04-4933-9be8-bfc6ed50c05d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:06.889663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c9e30765-af04-4933-9be8-bfc6ed50c05d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:06.889663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c9e30765-af04-4933-9be8-bfc6ed50c05d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:06.889663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c9e30765-af04-4933-9be8-bfc6ed50c05d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:06.889663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c9e30765-af04-4933-9be8-bfc6ed50c05d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:06.890342 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c9e30765-af04-4933-9be8-bfc6ed50c05d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:07.151773 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c9e30765-af04-4933-9be8-bfc6ed50c05d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:07.160901 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c9e30765-af04-4933-9be8-bfc6ed50c05d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.293733 Jun 02 14:02:07.162009 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 411/796] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:06 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:07.288396 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-b6fb16cf-2e35-425a-b29e-b9eb9efb6eb8 req-260e8513-395e-4d66-bb96-f5073a4155b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4253a95d-5443-4a20-9a10-621c058e8674", "name": "network-vif-plugged", "status": "completed", "tag": "7e76fdd4-e430-47ed-aee9-504128683d44"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:07.300797 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-b6fb16cf-2e35-425a-b29e-b9eb9efb6eb8 req-260e8513-395e-4d66-bb96-f5073a4155b2 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:07.301338 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-b6fb16cf-2e35-425a-b29e-b9eb9efb6eb8 req-260e8513-395e-4d66-bb96-f5073a4155b2 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:07.314069 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-b6fb16cf-2e35-425a-b29e-b9eb9efb6eb8 req-260e8513-395e-4d66-bb96-f5073a4155b2 service nova] Creating event network-vif-plugged:7e76fdd4-e430-47ed-aee9-504128683d44 for instance 4253a95d-5443-4a20-9a10-621c058e8674 on hv-cinder-82651 Jun 02 14:02:07.321042 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-b6fb16cf-2e35-425a-b29e-b9eb9efb6eb8 req-260e8513-395e-4d66-bb96-f5073a4155b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038405 Jun 02 14:02:07.321651 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 386/797] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:07.877299 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-c12bda29-8d48-4857-8842-29dad2bd07d2 req-ca245da1-1980-4a1a-94bb-6d91c4e97970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d778df4-cdc9-440b-acda-4b10357cb31f", "tag": "1bbbd139-07e3-43f6-afa9-e2d8b6eb9d5e"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:07.889184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-c12bda29-8d48-4857-8842-29dad2bd07d2 req-ca245da1-1980-4a1a-94bb-6d91c4e97970 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:07.890228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-c12bda29-8d48-4857-8842-29dad2bd07d2 req-ca245da1-1980-4a1a-94bb-6d91c4e97970 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:07.905351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-c12bda29-8d48-4857-8842-29dad2bd07d2 req-ca245da1-1980-4a1a-94bb-6d91c4e97970 service nova] Creating event network-changed:1bbbd139-07e3-43f6-afa9-e2d8b6eb9d5e for instance 6d778df4-cdc9-440b-acda-4b10357cb31f on hv-cinder-82651 Jun 02 14:02:07.911259 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-c12bda29-8d48-4857-8842-29dad2bd07d2 req-ca245da1-1980-4a1a-94bb-6d91c4e97970 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039016 Jun 02 14:02:07.911943 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 412/798] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:08.189063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3a892376-919a-40ef-a14f-be9f671325e5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:08.189775 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3a892376-919a-40ef-a14f-be9f671325e5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:08.196790 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3a892376-919a-40ef-a14f-be9f671325e5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:08.197238 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3a892376-919a-40ef-a14f-be9f671325e5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:08.198259 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3a892376-919a-40ef-a14f-be9f671325e5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:08.198803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3a892376-919a-40ef-a14f-be9f671325e5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:08.339532 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3a892376-919a-40ef-a14f-be9f671325e5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:08.347889 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3a892376-919a-40ef-a14f-be9f671325e5 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.172548 Jun 02 14:02:08.348392 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 387/799] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:08 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:09.366876 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7dcb698a-1403-44a2-916a-38cc10a5e4de tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:09.367622 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7dcb698a-1403-44a2-916a-38cc10a5e4de tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:09.373811 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7dcb698a-1403-44a2-916a-38cc10a5e4de tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:09.374341 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7dcb698a-1403-44a2-916a-38cc10a5e4de tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:09.375102 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7dcb698a-1403-44a2-916a-38cc10a5e4de tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:09.375539 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7dcb698a-1403-44a2-916a-38cc10a5e4de tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:09.522320 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7dcb698a-1403-44a2-916a-38cc10a5e4de tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:09.529939 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7dcb698a-1403-44a2-916a-38cc10a5e4de tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.168054 Jun 02 14:02:09.530508 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 413/800] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:09 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:10.521006 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-9a585772-8230-479b-a610-bbde82103349 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:10.521504 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-9a585772-8230-479b-a610-bbde82103349 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:10.528535 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9a585772-8230-479b-a610-bbde82103349 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:10.528928 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9a585772-8230-479b-a610-bbde82103349 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:10.529692 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9a585772-8230-479b-a610-bbde82103349 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:10.530123 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9a585772-8230-479b-a610-bbde82103349 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:10.546606 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e3d9299c-29e3-4cb5-b098-b2efbccdbbeb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:10.547226 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e3d9299c-29e3-4cb5-b098-b2efbccdbbeb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:10.554460 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e3d9299c-29e3-4cb5-b098-b2efbccdbbeb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:10.554909 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e3d9299c-29e3-4cb5-b098-b2efbccdbbeb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:10.555755 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e3d9299c-29e3-4cb5-b098-b2efbccdbbeb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:10.556113 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e3d9299c-29e3-4cb5-b098-b2efbccdbbeb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:10.560779 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-9a585772-8230-479b-a610-bbde82103349 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Going to try to terminate instance {{(pid=118315) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:02:10.712988 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e3d9299c-29e3-4cb5-b098-b2efbccdbbeb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:10.721449 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e3d9299c-29e3-4cb5-b098-b2efbccdbbeb tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1577 microversion: 2.1 time: 0.178735 Jun 02 14:02:10.724582 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 414/801] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:10 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:10.888108 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-9a585772-8230-479b-a610-bbde82103349 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 204 len: 0 microversion: 2.1 time: 0.371375 Jun 02 14:02:10.888800 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 388/802] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:02:10 2022] DELETE /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:02:10.896954 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4ccb952e-b337-45f3-8ddd-07240b6da4f8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:10.897587 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4ccb952e-b337-45f3-8ddd-07240b6da4f8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:10.903663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4ccb952e-b337-45f3-8ddd-07240b6da4f8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:10.904099 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4ccb952e-b337-45f3-8ddd-07240b6da4f8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:10.904870 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4ccb952e-b337-45f3-8ddd-07240b6da4f8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:10.905293 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4ccb952e-b337-45f3-8ddd-07240b6da4f8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:11.042917 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4ccb952e-b337-45f3-8ddd-07240b6da4f8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:11.052996 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4ccb952e-b337-45f3-8ddd-07240b6da4f8 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1507 microversion: 2.1 time: 0.160009 Jun 02 14:02:11.054190 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 415/803] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:10 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:11.739148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-34b896ad-b7ac-4bf3-8a94-ad92a85ef9b6 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:11.739852 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-34b896ad-b7ac-4bf3-8a94-ad92a85ef9b6 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:11.746347 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-34b896ad-b7ac-4bf3-8a94-ad92a85ef9b6 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:11.746794 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-34b896ad-b7ac-4bf3-8a94-ad92a85ef9b6 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:11.747555 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-34b896ad-b7ac-4bf3-8a94-ad92a85ef9b6 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:11.747992 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-34b896ad-b7ac-4bf3-8a94-ad92a85ef9b6 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:11.884894 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-34b896ad-b7ac-4bf3-8a94-ad92a85ef9b6 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:11.893152 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-34b896ad-b7ac-4bf3-8a94-ad92a85ef9b6 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1564 microversion: 2.1 time: 0.158433 Jun 02 14:02:11.893943 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 389/804] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:11 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:12.072243 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-90801142-dbab-44ca-9dde-35aa333ac769 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:12.073137 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-90801142-dbab-44ca-9dde-35aa333ac769 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:12.079857 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-90801142-dbab-44ca-9dde-35aa333ac769 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:12.080225 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-90801142-dbab-44ca-9dde-35aa333ac769 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:12.081035 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-90801142-dbab-44ca-9dde-35aa333ac769 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:12.081472 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-90801142-dbab-44ca-9dde-35aa333ac769 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:12.211022 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-90801142-dbab-44ca-9dde-35aa333ac769 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:12.218645 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-90801142-dbab-44ca-9dde-35aa333ac769 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1507 microversion: 2.1 time: 0.150297 Jun 02 14:02:12.219216 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 416/805] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:12 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:12.639908 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-f81886df-e55c-497e-8002-566c7d296dcc req-a8d3cbdf-40e0-48cc-9489-fa99e581d7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4ee4c28-6107-46d9-8461-8fcbd382c245", "name": "network-vif-deleted", "tag": "5133c089-5826-4ecd-ac3b-a6905f94a47a"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:12.649621 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-f81886df-e55c-497e-8002-566c7d296dcc req-a8d3cbdf-40e0-48cc-9489-fa99e581d7f4 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:12.652183 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-f81886df-e55c-497e-8002-566c7d296dcc req-a8d3cbdf-40e0-48cc-9489-fa99e581d7f4 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:12.661404 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-f81886df-e55c-497e-8002-566c7d296dcc req-a8d3cbdf-40e0-48cc-9489-fa99e581d7f4 service nova] Creating event network-vif-deleted:5133c089-5826-4ecd-ac3b-a6905f94a47a for instance f4ee4c28-6107-46d9-8461-8fcbd382c245 on hv-cinder-82651 Jun 02 14:02:12.666418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-f81886df-e55c-497e-8002-566c7d296dcc req-a8d3cbdf-40e0-48cc-9489-fa99e581d7f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030530 Jun 02 14:02:12.667014 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 390/806] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:02:13.235521 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-057d5a86-aff3-4fc5-bada-5aec77fbdbde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:13.236248 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-057d5a86-aff3-4fc5-bada-5aec77fbdbde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:13.243701 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-057d5a86-aff3-4fc5-bada-5aec77fbdbde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:13.244150 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-057d5a86-aff3-4fc5-bada-5aec77fbdbde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:13.244973 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-057d5a86-aff3-4fc5-bada-5aec77fbdbde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:13.245403 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-057d5a86-aff3-4fc5-bada-5aec77fbdbde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:13.275365 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-057d5a86-aff3-4fc5-bada-5aec77fbdbde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:13.275809 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-057d5a86-aff3-4fc5-bada-5aec77fbdbde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:13.276250 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-057d5a86-aff3-4fc5-bada-5aec77fbdbde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lazy-loading 'fault' on Instance uuid f4ee4c28-6107-46d9-8461-8fcbd382c245 {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:02:13.316992 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-057d5a86-aff3-4fc5-bada-5aec77fbdbde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:13.324653 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-057d5a86-aff3-4fc5-bada-5aec77fbdbde tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 200 len: 1312 microversion: 2.1 time: 0.093023 Jun 02 14:02:13.325216 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 417/807] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:13 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:14.342580 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fbf0a30d-6827-4e3e-be5f-35634fc778dd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:14.343291 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-fbf0a30d-6827-4e3e-be5f-35634fc778dd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: f4ee4c28-6107-46d9-8461-8fcbd382c245] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:14.345525 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:14.350511 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fbf0a30d-6827-4e3e-be5f-35634fc778dd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:14.350960 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fbf0a30d-6827-4e3e-be5f-35634fc778dd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:14.351724 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fbf0a30d-6827-4e3e-be5f-35634fc778dd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:14.352201 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fbf0a30d-6827-4e3e-be5f-35634fc778dd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:14.356215 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:14.365927 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-fbf0a30d-6827-4e3e-be5f-35634fc778dd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] HTTP exception thrown: Instance f4ee4c28-6107-46d9-8461-8fcbd382c245 could not be found. Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fbf0a30d-6827-4e3e-be5f-35634fc778dd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Request method failure captured: Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 HTTP/1.1 Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMD8es0jslrTw9H8zr0XMa1qVV_2yPyM188swiKF6vue0UYQNpH_rsvPjYaA-2ztdEbY44YK_QxUDWq9XJNDE3-Kz8Vz5C4hu7UZU9-dLcdNvHGNma-2ZrgZ_BK-9VNICseKjoeXmiFPmRH8MNBMa_-WjWv-iCJzdGCPmtouVpcN-84 Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: b067e3c448e24f179830992fecf65399 Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:02:14.367542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:02:14.369185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b067e3c448e24f179830992fecf65399"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b067e3c448e24f179830992fecf65399"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b067e3c448e24f179830992fecf65399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b067e3c448e24f179830992fecf65399"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:02:14.369185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 14:02:14.369185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: b067e3c448e24f179830992fecf65399 Jun 02 14:02:14.369185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 14:02:14.369185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-ServerRescueNegativeTestJSON-1754502689-project Jun 02 14:02:14.369185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:02:14.369185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:02:14.369185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: f9e57606c14a4ad99612414c1f9719f4 Jun 02 14:02:14.369185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1754502689-project Jun 02 14:02:14.369185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:02:14.369185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance f4ee4c28-6107-46d9-8461-8fcbd382c245 could not be found. Jun 02 14:02:14.369185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': 'f4ee4c28-6107-46d9-8461-8fcbd382c245'} Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4ee4c28-6107-46d9-8461-8fcbd382c245 could not be found. Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:02:14.370135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4ee4c28-6107-46d9-8461-8fcbd382c245 could not be found. Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4ee4c28-6107-46d9-8461-8fcbd382c245 could not be found. Jun 02 14:02:14.371926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:14.373376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fbf0a30d-6827-4e3e-be5f-35634fc778dd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Returning 404 to user: Instance f4ee4c28-6107-46d9-8461-8fcbd382c245 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:02:14.373376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-fbf0a30d-6827-4e3e-be5f-35634fc778dd tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245" status: 404 len: 111 microversion: 2.1 time: 0.031702 Jun 02 14:02:14.373376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 391/808] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:14 2022] GET /compute/v2.1/servers/f4ee4c28-6107-46d9-8461-8fcbd382c245 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:02:14.377541 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7512298d-9131-441b-8c9b-443c0a1816d5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:14.378069 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7512298d-9131-441b-8c9b-443c0a1816d5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:14.385223 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7512298d-9131-441b-8c9b-443c0a1816d5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:14.385699 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7512298d-9131-441b-8c9b-443c0a1816d5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:14.386463 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7512298d-9131-441b-8c9b-443c0a1816d5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:14.386892 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7512298d-9131-441b-8c9b-443c0a1816d5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:14.411363 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7512298d-9131-441b-8c9b-443c0a1816d5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Going to try to terminate instance {{(pid=118316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:02:14.414150 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:14.690757 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7512298d-9131-441b-8c9b-443c0a1816d5 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "DELETE /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 204 len: 0 microversion: 2.1 time: 0.316784 Jun 02 14:02:14.691490 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 418/809] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:02:14 2022] DELETE /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 02 14:02:14.700568 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2a9b8e1c-9fd6-4b5a-8136-29881af83f14 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:14.701186 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-2a9b8e1c-9fd6-4b5a-8136-29881af83f14 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:14.708216 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2a9b8e1c-9fd6-4b5a-8136-29881af83f14 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:14.708715 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2a9b8e1c-9fd6-4b5a-8136-29881af83f14 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:14.709478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2a9b8e1c-9fd6-4b5a-8136-29881af83f14 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:14.709916 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2a9b8e1c-9fd6-4b5a-8136-29881af83f14 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:14.844646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2a9b8e1c-9fd6-4b5a-8136-29881af83f14 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:14.852848 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2a9b8e1c-9fd6-4b5a-8136-29881af83f14 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.157159 Jun 02 14:02:14.853426 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 392/810] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:14 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:15.870799 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ce04ec63-cf84-4beb-a481-4cb2f429094a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:15.871412 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ce04ec63-cf84-4beb-a481-4cb2f429094a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:15.877924 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ce04ec63-cf84-4beb-a481-4cb2f429094a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:15.878368 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ce04ec63-cf84-4beb-a481-4cb2f429094a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:15.880246 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ce04ec63-cf84-4beb-a481-4cb2f429094a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:15.880712 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ce04ec63-cf84-4beb-a481-4cb2f429094a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:16.012795 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ce04ec63-cf84-4beb-a481-4cb2f429094a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:16.020362 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ce04ec63-cf84-4beb-a481-4cb2f429094a tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1521 microversion: 2.1 time: 0.153891 Jun 02 14:02:16.020947 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 419/811] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:15 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:16.476567 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3b6c14e7-79ba-41c3-8f9e-00cf9c08a375 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:16.477045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3b6c14e7-79ba-41c3-8f9e-00cf9c08a375 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:16.483103 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3b6c14e7-79ba-41c3-8f9e-00cf9c08a375 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:16.483545 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3b6c14e7-79ba-41c3-8f9e-00cf9c08a375 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:16.484332 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3b6c14e7-79ba-41c3-8f9e-00cf9c08a375 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:16.484779 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3b6c14e7-79ba-41c3-8f9e-00cf9c08a375 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:16.509322 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3b6c14e7-79ba-41c3-8f9e-00cf9c08a375 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2/ips" status: 200 len: 149 microversion: 2.1 time: 0.089563 Jun 02 14:02:16.509931 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 393/812] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 2 14:02:16 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2/ips => generated 149 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:02:16.521092 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-06cbca14-dcfd-4283-82a2-9339dbf83d14 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3174d151-d953-4324-b56e-688b2d07d880"}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:16.522210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-06cbca14-dcfd-4283-82a2-9339dbf83d14 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:16.528143 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-06cbca14-dcfd-4283-82a2-9339dbf83d14 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:16.528635 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-06cbca14-dcfd-4283-82a2-9339dbf83d14 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:16.538033 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-06cbca14-dcfd-4283-82a2-9339dbf83d14 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:16.538033 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-06cbca14-dcfd-4283-82a2-9339dbf83d14 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:16.611709 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-06cbca14-dcfd-4283-82a2-9339dbf83d14 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] HTTP exception thrown: Invalid volume: volume 3174d151-d953-4324-b56e-688b2d07d880 is already attached to instances: c4ee5a26-ff9a-4c58-98a4-2664248a553f Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-06cbca14-dcfd-4283-82a2-9339dbf83d14 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Request method failure captured: Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: POST /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2/os-volume_attachments HTTP/1.1 Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 74 Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMFy_PkjCh8nju-jA0VaYoRe27Sdij_PJ-vL-9HGf9m-cRULoAY2MzvH3r9nOTiF2_SNa0DGTaap7M-J4JHAJNrDHS-wszymM6zEqEWgK8stKwPY-XOb5tLiYFnXd51Ue2ODNQOEzPNwMcb1Mm2IHy1m8FAhNZxug520YoLsr6cRsBI Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:02:16.613513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:02:16.615066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f72940f7df74b898595c0ed9c654502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:02:16.615066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:02:16.615066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:02:16.615066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:02:16.615066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:02:16.615066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:02:16.615066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:02:16.615066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: b8d05eeb8ac146969b99d33084f1664c Jun 02 14:02:16.615066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:02:16.615066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Jun 02 14:02:16.615066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {"volumeAttachment": {"volumeId": "3174d151-d953-4324-b56e-688b2d07d880"}} Jun 02 14:02:16.615066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Invalid volume: volume 3174d151-d953-4324-b56e-688b2d07d880 is already attached to instances: c4ee5a26-ff9a-4c58-98a4-2664248a553f Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'server_id': 'f6d1d51b-029d-43f1-ba8b-15f5ce6211e2', 'body': {'volumeAttachment': {'volumeId': '3174d151-d953-4324-b56e-688b2d07d880'}}} Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3174d151-d953-4324-b56e-688b2d07d880 is already attached to instances: c4ee5a26-ff9a-4c58-98a4-2664248a553f Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:02:16.615911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3174d151-d953-4324-b56e-688b2d07d880 is already attached to instances: c4ee5a26-ff9a-4c58-98a4-2664248a553f Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:16.617683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:02:16.620042 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:02:16.620042 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:02:16.620042 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:02:16.620042 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3174d151-d953-4324-b56e-688b2d07d880 is already attached to instances: c4ee5a26-ff9a-4c58-98a4-2664248a553f Jun 02 14:02:16.620042 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:02:16.620042 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-06cbca14-dcfd-4283-82a2-9339dbf83d14 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Returning 400 to user: Invalid volume: volume 3174d151-d953-4324-b56e-688b2d07d880 is already attached to instances: c4ee5a26-ff9a-4c58-98a4-2664248a553f {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:02:16.620042 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-06cbca14-dcfd-4283-82a2-9339dbf83d14 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "POST /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098425 Jun 02 14:02:16.620042 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 420/813] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 2 14:02:16 2022] POST /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 14:02:16.623879 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4aace694-3dab-486f-83c2-802d72827188 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:16.624374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4aace694-3dab-486f-83c2-802d72827188 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:16.630831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4aace694-3dab-486f-83c2-802d72827188 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:16.631241 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4aace694-3dab-486f-83c2-802d72827188 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:16.632000 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4aace694-3dab-486f-83c2-802d72827188 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:16.632448 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4aace694-3dab-486f-83c2-802d72827188 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:16.661284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4aace694-3dab-486f-83c2-802d72827188 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Going to try to terminate instance {{(pid=118315) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:02:16.681394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-c786fdca-0421-449b-8f25-96455a14756e req-e17f7193-44d5-403e-9fd1-acb2cc8eb022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478fcfd0-657e-41c0-b9f2-38f449129a3b", "name": "network-vif-deleted", "tag": "96fe44df-3a9f-4a2e-937a-7e7f60525297"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:16.690475 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-c786fdca-0421-449b-8f25-96455a14756e req-e17f7193-44d5-403e-9fd1-acb2cc8eb022 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:16.691129 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-c786fdca-0421-449b-8f25-96455a14756e req-e17f7193-44d5-403e-9fd1-acb2cc8eb022 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:16.710519 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-c786fdca-0421-449b-8f25-96455a14756e req-e17f7193-44d5-403e-9fd1-acb2cc8eb022 service nova] Creating event network-vif-deleted:96fe44df-3a9f-4a2e-937a-7e7f60525297 for instance 478fcfd0-657e-41c0-b9f2-38f449129a3b on hv-cinder-82651 Jun 02 14:02:16.716138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-c786fdca-0421-449b-8f25-96455a14756e req-e17f7193-44d5-403e-9fd1-acb2cc8eb022 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040216 Jun 02 14:02:16.717159 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 421/814] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:02:16.956472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4aace694-3dab-486f-83c2-802d72827188 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 204 len: 0 microversion: 2.1 time: 0.336347 Jun 02 14:02:16.957926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 394/815] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:02:16 2022] DELETE /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:02:16.968622 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b3887b08-8ec2-48f0-8b86-8d38dd8690b9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:16.969631 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b3887b08-8ec2-48f0-8b86-8d38dd8690b9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:16.977895 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b3887b08-8ec2-48f0-8b86-8d38dd8690b9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:16.978415 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b3887b08-8ec2-48f0-8b86-8d38dd8690b9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:16.979573 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b3887b08-8ec2-48f0-8b86-8d38dd8690b9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:16.979884 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b3887b08-8ec2-48f0-8b86-8d38dd8690b9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:17.037667 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3c9f9838-340b-4623-a5d9-ff9cf9aef811 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:17.038360 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3c9f9838-340b-4623-a5d9-ff9cf9aef811 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:17.044503 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3c9f9838-340b-4623-a5d9-ff9cf9aef811 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:17.044950 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3c9f9838-340b-4623-a5d9-ff9cf9aef811 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:17.045699 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3c9f9838-340b-4623-a5d9-ff9cf9aef811 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:17.046131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3c9f9838-340b-4623-a5d9-ff9cf9aef811 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:17.127304 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3c9f9838-340b-4623-a5d9-ff9cf9aef811 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:17.135304 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3c9f9838-340b-4623-a5d9-ff9cf9aef811 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1307 microversion: 2.1 time: 0.101939 Jun 02 14:02:17.135873 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 395/816] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:17 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:17.156970 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b3887b08-8ec2-48f0-8b86-8d38dd8690b9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:17.164739 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b3887b08-8ec2-48f0-8b86-8d38dd8690b9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1681 microversion: 2.1 time: 0.201556 Jun 02 14:02:17.165767 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 422/817] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:16 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:18.152841 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-16b02480-5d80-4063-b5bc-a94df048de3c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:18.160653 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-16b02480-5d80-4063-b5bc-a94df048de3c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:18.160653 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-16b02480-5d80-4063-b5bc-a94df048de3c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:18.161239 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-16b02480-5d80-4063-b5bc-a94df048de3c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:18.162007 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-16b02480-5d80-4063-b5bc-a94df048de3c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:18.162444 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-16b02480-5d80-4063-b5bc-a94df048de3c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:18.183434 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-84f1325c-5aaa-48dc-82d9-8653e5e5d9c1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:18.184043 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-84f1325c-5aaa-48dc-82d9-8653e5e5d9c1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:18.190891 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84f1325c-5aaa-48dc-82d9-8653e5e5d9c1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:18.191926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84f1325c-5aaa-48dc-82d9-8653e5e5d9c1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:18.192718 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84f1325c-5aaa-48dc-82d9-8653e5e5d9c1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:18.193152 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84f1325c-5aaa-48dc-82d9-8653e5e5d9c1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:18.193282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-16b02480-5d80-4063-b5bc-a94df048de3c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:18.193656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-16b02480-5d80-4063-b5bc-a94df048de3c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:18.194109 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-16b02480-5d80-4063-b5bc-a94df048de3c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lazy-loading 'fault' on Instance uuid 478fcfd0-657e-41c0-b9f2-38f449129a3b {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:02:18.244643 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-16b02480-5d80-4063-b5bc-a94df048de3c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:18.252260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-16b02480-5d80-4063-b5bc-a94df048de3c tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1312 microversion: 2.1 time: 0.103306 Jun 02 14:02:18.255279 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 396/818] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:18 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:18.341223 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-84f1325c-5aaa-48dc-82d9-8653e5e5d9c1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:18.349608 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-84f1325c-5aaa-48dc-82d9-8653e5e5d9c1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1681 microversion: 2.1 time: 0.169916 Jun 02 14:02:18.350193 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 423/819] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:18 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:19.268285 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-861444fe-0f1c-4612-aa28-ac9dafa314c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:19.268939 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-861444fe-0f1c-4612-aa28-ac9dafa314c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:19.275623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-861444fe-0f1c-4612-aa28-ac9dafa314c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:19.276073 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-861444fe-0f1c-4612-aa28-ac9dafa314c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:19.276873 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-861444fe-0f1c-4612-aa28-ac9dafa314c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:19.277307 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-861444fe-0f1c-4612-aa28-ac9dafa314c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:19.308130 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-861444fe-0f1c-4612-aa28-ac9dafa314c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:19.308616 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-861444fe-0f1c-4612-aa28-ac9dafa314c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:19.309060 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-861444fe-0f1c-4612-aa28-ac9dafa314c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lazy-loading 'fault' on Instance uuid 478fcfd0-657e-41c0-b9f2-38f449129a3b {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:02:19.353487 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-861444fe-0f1c-4612-aa28-ac9dafa314c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e57606c14a4ad99612414c1f9719f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b067e3c448e24f179830992fecf65399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:19.360867 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-861444fe-0f1c-4612-aa28-ac9dafa314c4 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 200 len: 1312 microversion: 2.1 time: 0.096427 Jun 02 14:02:19.361426 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 397/820] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:19 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:19.367338 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c7690787-d288-4edd-861a-17bc3fffebda tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:19.368042 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c7690787-d288-4edd-861a-17bc3fffebda tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:19.374338 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c7690787-d288-4edd-861a-17bc3fffebda tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:19.374780 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c7690787-d288-4edd-861a-17bc3fffebda tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:19.375525 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c7690787-d288-4edd-861a-17bc3fffebda tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:19.375968 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c7690787-d288-4edd-861a-17bc3fffebda tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:19.508217 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c7690787-d288-4edd-861a-17bc3fffebda tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:19.515762 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c7690787-d288-4edd-861a-17bc3fffebda tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1681 microversion: 2.1 time: 0.152781 Jun 02 14:02:19.516333 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 424/821] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:19 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:20.388198 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-20b677c1-fcd6-4aaf-9e81-3e3f44a94771 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:20.388860 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-20b677c1-fcd6-4aaf-9e81-3e3f44a94771 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] [instance: 478fcfd0-657e-41c0-b9f2-38f449129a3b] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:20.410709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-20b677c1-fcd6-4aaf-9e81-3e3f44a94771 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:20.410709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-20b677c1-fcd6-4aaf-9e81-3e3f44a94771 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:20.410709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-20b677c1-fcd6-4aaf-9e81-3e3f44a94771 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:20.410709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-20b677c1-fcd6-4aaf-9e81-3e3f44a94771 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:20.415118 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-20b677c1-fcd6-4aaf-9e81-3e3f44a94771 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] HTTP exception thrown: Instance 478fcfd0-657e-41c0-b9f2-38f449129a3b could not be found. Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-20b677c1-fcd6-4aaf-9e81-3e3f44a94771 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Request method failure captured: Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b HTTP/1.1 Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMD8es0jslrTw9H8zr0XMa1qVV_2yPyM188swiKF6vue0UYQNpH_rsvPjYaA-2ztdEbY44YK_QxUDWq9XJNDE3-Kz8Vz5C4hu7UZU9-dLcdNvHGNma-2ZrgZ_BK-9VNICseKjoeXmiFPmRH8MNBMa_-WjWv-iCJzdGCPmtouVpcN-84 Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: b067e3c448e24f179830992fecf65399 Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:02:20.416830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:02:20.418361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b067e3c448e24f179830992fecf65399"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b067e3c448e24f179830992fecf65399"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b067e3c448e24f179830992fecf65399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b067e3c448e24f179830992fecf65399"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:02:20.418361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 14:02:20.418361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: b067e3c448e24f179830992fecf65399 Jun 02 14:02:20.418361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1754502689 Jun 02 14:02:20.418361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-ServerRescueNegativeTestJSON-1754502689-project Jun 02 14:02:20.418361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:02:20.418361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:02:20.418361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: f9e57606c14a4ad99612414c1f9719f4 Jun 02 14:02:20.418361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1754502689-project Jun 02 14:02:20.418361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:02:20.418361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance 478fcfd0-657e-41c0-b9f2-38f449129a3b could not be found. Jun 02 14:02:20.418361 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '478fcfd0-657e-41c0-b9f2-38f449129a3b'} Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478fcfd0-657e-41c0-b9f2-38f449129a3b could not be found. Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:02:20.419126 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478fcfd0-657e-41c0-b9f2-38f449129a3b could not be found. Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478fcfd0-657e-41c0-b9f2-38f449129a3b could not be found. Jun 02 14:02:20.420388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:20.421577 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-20b677c1-fcd6-4aaf-9e81-3e3f44a94771 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] Returning 404 to user: Instance 478fcfd0-657e-41c0-b9f2-38f449129a3b could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:02:20.421577 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-20b677c1-fcd6-4aaf-9e81-3e3f44a94771 tempest-ServerRescueNegativeTestJSON-1754502689 tempest-ServerRescueNegativeTestJSON-1754502689-project] 10.222.0.33 "GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b" status: 404 len: 111 microversion: 2.1 time: 0.043554 Jun 02 14:02:20.421577 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 398/822] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:20 2022] GET /compute/v2.1/servers/478fcfd0-657e-41c0-b9f2-38f449129a3b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:02:20.535311 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f0a1ff68-5034-478e-8dd3-5317122bdd2a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:20.536467 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f0a1ff68-5034-478e-8dd3-5317122bdd2a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:20.543677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f0a1ff68-5034-478e-8dd3-5317122bdd2a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:20.544216 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f0a1ff68-5034-478e-8dd3-5317122bdd2a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:20.545092 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f0a1ff68-5034-478e-8dd3-5317122bdd2a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:20.545586 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f0a1ff68-5034-478e-8dd3-5317122bdd2a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:20.648478 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f0a1ff68-5034-478e-8dd3-5317122bdd2a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:20.673352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-7e691901-e952-4a15-b547-e50f58e7b44a req-b2168ad1-730e-41e3-88be-c40da1ed0cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d1d51b-029d-43f1-ba8b-15f5ce6211e2", "name": "network-vif-deleted", "tag": "fd0e9007-c941-4e85-8d7d-de310b3e3208"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:20.679993 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f0a1ff68-5034-478e-8dd3-5317122bdd2a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1613 microversion: 2.1 time: 0.135212 Jun 02 14:02:20.680553 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 425/823] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:20 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1613 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:20.685220 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-7e691901-e952-4a15-b547-e50f58e7b44a req-b2168ad1-730e-41e3-88be-c40da1ed0cd4 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:20.685903 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-7e691901-e952-4a15-b547-e50f58e7b44a req-b2168ad1-730e-41e3-88be-c40da1ed0cd4 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:20.702371 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-7e691901-e952-4a15-b547-e50f58e7b44a req-b2168ad1-730e-41e3-88be-c40da1ed0cd4 service nova] Creating event network-vif-deleted:fd0e9007-c941-4e85-8d7d-de310b3e3208 for instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 on hv-cinder-82651 Jun 02 14:02:20.707482 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-7e691901-e952-4a15-b547-e50f58e7b44a req-b2168ad1-730e-41e3-88be-c40da1ed0cd4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040086 Jun 02 14:02:20.708532 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 399/824] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:02:21.702336 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-85dbab4a-8514-4fcc-a100-f8f3b2b186a1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:21.702983 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-85dbab4a-8514-4fcc-a100-f8f3b2b186a1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:21.709739 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-85dbab4a-8514-4fcc-a100-f8f3b2b186a1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:21.710186 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-85dbab4a-8514-4fcc-a100-f8f3b2b186a1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:21.711012 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-85dbab4a-8514-4fcc-a100-f8f3b2b186a1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:21.711618 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-85dbab4a-8514-4fcc-a100-f8f3b2b186a1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:21.746706 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-85dbab4a-8514-4fcc-a100-f8f3b2b186a1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:21.747152 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-85dbab4a-8514-4fcc-a100-f8f3b2b186a1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:21.747598 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-85dbab4a-8514-4fcc-a100-f8f3b2b186a1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lazy-loading 'fault' on Instance uuid f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:02:21.807052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-85dbab4a-8514-4fcc-a100-f8f3b2b186a1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:21.815085 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-85dbab4a-8514-4fcc-a100-f8f3b2b186a1 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 200 len: 1331 microversion: 2.1 time: 0.116508 Jun 02 14:02:21.815861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 426/825] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:21 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:22.834053 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-65705487-d528-494a-857f-ca7f18bdc79c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:22.844449 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-65705487-d528-494a-857f-ca7f18bdc79c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:22.844449 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-65705487-d528-494a-857f-ca7f18bdc79c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:22.844449 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-65705487-d528-494a-857f-ca7f18bdc79c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:22.844449 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-65705487-d528-494a-857f-ca7f18bdc79c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:22.845020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-65705487-d528-494a-857f-ca7f18bdc79c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:22.860221 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-65705487-d528-494a-857f-ca7f18bdc79c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] HTTP exception thrown: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-65705487-d528-494a-857f-ca7f18bdc79c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Request method failure captured: Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 HTTP/1.1 Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMFy_PkjCh8nju-jA0VaYoRe27Sdij_PJ-vL-9HGf9m-cRULoAY2MzvH3r9nOTiF2_SNa0DGTaap7M-J4JHAJNrDHS-wszymM6zEqEWgK8stKwPY-XOb5tLiYFnXd51Ue2ODNQOEzPNwMcb1Mm2IHy1m8FAhNZxug520YoLsr6cRsBI Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:02:22.862284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:02:22.864604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f72940f7df74b898595c0ed9c654502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:02:22.864604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:02:22.864604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:02:22.864604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:02:22.864604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:02:22.864604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:02:22.864604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:02:22.864604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: b8d05eeb8ac146969b99d33084f1664c Jun 02 14:02:22.864604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:02:22.864604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:02:22.864604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:02:22.864604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': 'f6d1d51b-029d-43f1-ba8b-15f5ce6211e2'} Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:02:22.865914 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:02:22.867113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:22.868223 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-65705487-d528-494a-857f-ca7f18bdc79c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Returning 404 to user: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:02:22.868223 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-65705487-d528-494a-857f-ca7f18bdc79c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 404 len: 111 microversion: 2.1 time: 0.034586 Jun 02 14:02:22.868223 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 400/826] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:22 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:02:22.873488 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4a2f941f-8234-4b78-8814-43ab87e3ded3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '.version_select at 0x7fb720262550>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:23.001941 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4a2f941f-8234-4b78-8814-43ab87e3ded3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-525634832" status: 202 len: 0 microversion: 2.1 time: 0.131331 Jun 02 14:02:23.002837 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 427/827] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 2 14:02:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-525634832 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:02:23.959887 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a9d0bd2c-bbda-4510-912f-039a3691da4e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:23.960397 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a9d0bd2c-bbda-4510-912f-039a3691da4e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:23.967212 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a9d0bd2c-bbda-4510-912f-039a3691da4e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:23.967662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a9d0bd2c-bbda-4510-912f-039a3691da4e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:23.968564 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a9d0bd2c-bbda-4510-912f-039a3691da4e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:23.969002 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a9d0bd2c-bbda-4510-912f-039a3691da4e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:24.071629 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-a9d0bd2c-bbda-4510-912f-039a3691da4e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lazy-loading 'services' on Instance uuid c4ee5a26-ff9a-4c58-98a4-2664248a553f {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:02:24.308205 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a9d0bd2c-bbda-4510-912f-039a3691da4e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f/os-volume_attachments/3174d151-d953-4324-b56e-688b2d07d880" status: 202 len: 0 microversion: 2.1 time: 0.352762 Jun 02 14:02:24.311157 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 401/828] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 2 14:02:23 2022] DELETE /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f/os-volume_attachments/3174d151-d953-4324-b56e-688b2d07d880 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:02:24.319762 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6a6d3358-be8f-48ec-a970-7725be6e4966 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:24.321285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6a6d3358-be8f-48ec-a970-7725be6e4966 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:24.330449 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6a6d3358-be8f-48ec-a970-7725be6e4966 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:24.330826 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6a6d3358-be8f-48ec-a970-7725be6e4966 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:24.332236 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6a6d3358-be8f-48ec-a970-7725be6e4966 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:24.332760 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6a6d3358-be8f-48ec-a970-7725be6e4966 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:24.371161 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6a6d3358-be8f-48ec-a970-7725be6e4966 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057921 Jun 02 14:02:24.371932 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 428/829] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:02:24 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:25.384726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4379151c-702b-47fb-9dcd-5306e92def0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:25.385782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4379151c-702b-47fb-9dcd-5306e92def0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:25.391928 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4379151c-702b-47fb-9dcd-5306e92def0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:25.392609 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4379151c-702b-47fb-9dcd-5306e92def0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:25.393384 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4379151c-702b-47fb-9dcd-5306e92def0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:25.393812 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4379151c-702b-47fb-9dcd-5306e92def0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:25.424254 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4379151c-702b-47fb-9dcd-5306e92def0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044768 Jun 02 14:02:25.424769 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 402/830] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:02:25 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:02:26.437214 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-1522cf55-69c6-47f5-9461-f455519bc1a5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:26.438150 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-1522cf55-69c6-47f5-9461-f455519bc1a5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:26.444785 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1522cf55-69c6-47f5-9461-f455519bc1a5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:26.445238 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1522cf55-69c6-47f5-9461-f455519bc1a5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:26.446006 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1522cf55-69c6-47f5-9461-f455519bc1a5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:26.446444 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1522cf55-69c6-47f5-9461-f455519bc1a5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:26.478768 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-1522cf55-69c6-47f5-9461-f455519bc1a5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045489 Jun 02 14:02:26.479343 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 429/831] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:02:26 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 14:02:26.538265 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b2cd3cbf-98ec-4094-b608-c0c678aa56eb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:26.538763 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b2cd3cbf-98ec-4094-b608-c0c678aa56eb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:26.545225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b2cd3cbf-98ec-4094-b608-c0c678aa56eb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:26.545667 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b2cd3cbf-98ec-4094-b608-c0c678aa56eb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:26.546416 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b2cd3cbf-98ec-4094-b608-c0c678aa56eb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:26.546848 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b2cd3cbf-98ec-4094-b608-c0c678aa56eb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:26.574006 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b2cd3cbf-98ec-4094-b608-c0c678aa56eb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Going to try to terminate instance {{(pid=118315) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:02:26.828008 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b2cd3cbf-98ec-4094-b608-c0c678aa56eb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 204 len: 0 microversion: 2.1 time: 0.294575 Jun 02 14:02:26.828634 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 403/832] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:02:26 2022] DELETE /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:02:26.837923 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-87e04826-6923-4c37-b30a-9d1a17fb1561 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:26.838531 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-87e04826-6923-4c37-b30a-9d1a17fb1561 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:26.844983 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-87e04826-6923-4c37-b30a-9d1a17fb1561 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:26.845422 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-87e04826-6923-4c37-b30a-9d1a17fb1561 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:26.846912 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-87e04826-6923-4c37-b30a-9d1a17fb1561 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:26.846912 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-87e04826-6923-4c37-b30a-9d1a17fb1561 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:26.981697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-87e04826-6923-4c37-b30a-9d1a17fb1561 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:26.990335 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-87e04826-6923-4c37-b30a-9d1a17fb1561 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1680 microversion: 2.1 time: 0.156335 Jun 02 14:02:26.991110 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 430/833] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:26 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:28.010153 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-78380150-23fe-4d4f-a58d-35aa284c1204 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:28.010854 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-78380150-23fe-4d4f-a58d-35aa284c1204 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:28.017780 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-78380150-23fe-4d4f-a58d-35aa284c1204 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:28.018234 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-78380150-23fe-4d4f-a58d-35aa284c1204 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:28.023406 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-78380150-23fe-4d4f-a58d-35aa284c1204 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:28.023406 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-78380150-23fe-4d4f-a58d-35aa284c1204 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:28.279246 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-78380150-23fe-4d4f-a58d-35aa284c1204 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:28.289700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-78380150-23fe-4d4f-a58d-35aa284c1204 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1680 microversion: 2.1 time: 0.284060 Jun 02 14:02:28.290763 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 404/834] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:28 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1680 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:29.307488 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0121718e-ae5d-4eb6-8c69-424d8ff4f86d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:29.308747 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0121718e-ae5d-4eb6-8c69-424d8ff4f86d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:29.315838 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0121718e-ae5d-4eb6-8c69-424d8ff4f86d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:29.316511 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0121718e-ae5d-4eb6-8c69-424d8ff4f86d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:29.317635 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0121718e-ae5d-4eb6-8c69-424d8ff4f86d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:29.318074 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0121718e-ae5d-4eb6-8c69-424d8ff4f86d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:29.772441 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0121718e-ae5d-4eb6-8c69-424d8ff4f86d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:29.783158 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0121718e-ae5d-4eb6-8c69-424d8ff4f86d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1680 microversion: 2.1 time: 0.479668 Jun 02 14:02:29.783992 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 431/835] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:29 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1680 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:29.843278 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-af605757-f9d6-42d9-82ab-8c2d0536e7d9 req-953f2393-2325-48f8-b530-cc263f881353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ee5a26-ff9a-4c58-98a4-2664248a553f", "name": "network-vif-deleted", "tag": "655f824c-2cda-4ff5-9c52-ef0a03e0689a"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:29.873083 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-af605757-f9d6-42d9-82ab-8c2d0536e7d9 req-953f2393-2325-48f8-b530-cc263f881353 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:29.873980 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-af605757-f9d6-42d9-82ab-8c2d0536e7d9 req-953f2393-2325-48f8-b530-cc263f881353 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:29.890771 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-af605757-f9d6-42d9-82ab-8c2d0536e7d9 req-953f2393-2325-48f8-b530-cc263f881353 service nova] Creating event network-vif-deleted:655f824c-2cda-4ff5-9c52-ef0a03e0689a for instance c4ee5a26-ff9a-4c58-98a4-2664248a553f on hv-cinder-82651 Jun 02 14:02:29.899125 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-af605757-f9d6-42d9-82ab-8c2d0536e7d9 req-953f2393-2325-48f8-b530-cc263f881353 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063467 Jun 02 14:02:29.900462 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 405/836] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:30.802784 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-777344c1-ef3f-4c5f-9ef6-82eed8d445f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:30.803369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-777344c1-ef3f-4c5f-9ef6-82eed8d445f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:30.806189 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:30.815654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-777344c1-ef3f-4c5f-9ef6-82eed8d445f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:30.816110 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-777344c1-ef3f-4c5f-9ef6-82eed8d445f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:30.820885 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-777344c1-ef3f-4c5f-9ef6-82eed8d445f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:30.821338 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-777344c1-ef3f-4c5f-9ef6-82eed8d445f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:30.876230 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-777344c1-ef3f-4c5f-9ef6-82eed8d445f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:30.876914 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-777344c1-ef3f-4c5f-9ef6-82eed8d445f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:30.877537 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-777344c1-ef3f-4c5f-9ef6-82eed8d445f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lazy-loading 'fault' on Instance uuid c4ee5a26-ff9a-4c58-98a4-2664248a553f {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:02:30.948384 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-777344c1-ef3f-4c5f-9ef6-82eed8d445f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:30.959510 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-777344c1-ef3f-4c5f-9ef6-82eed8d445f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 200 len: 1330 microversion: 2.1 time: 0.162040 Jun 02 14:02:30.976314 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 432/837] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:30 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 1330 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:31.981820 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-78f10792-ed54-4a91-95f3-930648b6ad59 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:31.984731 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-78f10792-ed54-4a91-95f3-930648b6ad59 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:31.991066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-78f10792-ed54-4a91-95f3-930648b6ad59 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:31.991775 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-78f10792-ed54-4a91-95f3-930648b6ad59 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:31.992753 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-78f10792-ed54-4a91-95f3-930648b6ad59 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:31.993193 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-78f10792-ed54-4a91-95f3-930648b6ad59 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:32.007570 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-78f10792-ed54-4a91-95f3-930648b6ad59 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] HTTP exception thrown: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-78f10792-ed54-4a91-95f3-930648b6ad59 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Request method failure captured: Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f HTTP/1.1 Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMFy_PkjCh8nju-jA0VaYoRe27Sdij_PJ-vL-9HGf9m-cRULoAY2MzvH3r9nOTiF2_SNa0DGTaap7M-J4JHAJNrDHS-wszymM6zEqEWgK8stKwPY-XOb5tLiYFnXd51Ue2ODNQOEzPNwMcb1Mm2IHy1m8FAhNZxug520YoLsr6cRsBI Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:02:32.009263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:02:32.010909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f72940f7df74b898595c0ed9c654502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:02:32.010909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:02:32.010909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:02:32.010909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:02:32.010909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:02:32.010909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:02:32.010909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:02:32.010909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: b8d05eeb8ac146969b99d33084f1664c Jun 02 14:02:32.010909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:02:32.010909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:02:32.010909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:02:32.010909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': 'c4ee5a26-ff9a-4c58-98a4-2664248a553f'} Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:02:32.011818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:02:32.013352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:02:32.014765 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-78f10792-ed54-4a91-95f3-930648b6ad59 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Returning 404 to user: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:02:32.014765 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-78f10792-ed54-4a91-95f3-930648b6ad59 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 404 len: 111 microversion: 2.1 time: 0.034082 Jun 02 14:02:32.014765 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 406/838] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:31 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:02:32.019575 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-399638f3-ec53-4c27-afef-1fbde9eb02d2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '.version_select at 0x7fb71ae8ca60>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:32.092092 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-399638f3-ec53-4c27-afef-1fbde9eb02d2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-176488862" status: 202 len: 0 microversion: 2.1 time: 0.076142 Jun 02 14:02:32.095900 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 433/839] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 2 14:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-176488862 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:02:32.685153 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-38456406-cb44-4cd3-996f-55410c6ce7a1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Action: 'create', calling method: .version_select at 0x7fb71aed5280>, body: {"keypair": {"name": "tempest-keypair-2146280950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3lTEx5AWa0aord0M9bymJvcDChpq0pAJGKlZN6hDKAc53R+fRx7rUFuQla2twmGjx6W+wJmXOSEHsG3/eLZld4QL9P4dUSeO2Sn90jm5czkEwVH1Sqtoup8SKZsXroXA=="}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:32.700610 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-38456406-cb44-4cd3-996f-55410c6ce7a1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Getting quotas for project fbb232ab0a2347dea2fa82e1cdbf24b5. Resources: {'key_pairs'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:02:32.704867 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-38456406-cb44-4cd3-996f-55410c6ce7a1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Getting quotas for user 36e78feea3104797a5e927c8ffb76d18 and project fbb232ab0a2347dea2fa82e1cdbf24b5. Resources: {'key_pairs'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:02:32.858908 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-38456406-cb44-4cd3-996f-55410c6ce7a1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.314238 Jun 02 14:02:32.859760 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 407/840] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 2 14:02:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:33.019302 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-01f63fa2-e417-4898-8e2c-4c5e98960f9f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Action: 'create', calling method: .version_select at 0x7fb720084790>, body: {"keypair": {"name": "tempest-keypair-1145678587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcDRxqRJiYbUalGUfLRwtf63eTO8N2QpCt9DmN7kNpSys6g5NEKzNW8n5jIRI/Sb2A8Qx6+zRehEkNVmwaEbTFWrsX/+Hq4onr13kELYrTqySt2PI4aACs+JioOUJYIWQ=="}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:33.035521 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-01f63fa2-e417-4898-8e2c-4c5e98960f9f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for project 8f72940f7df74b898595c0ed9c654502. Resources: {'key_pairs'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:02:33.039669 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-01f63fa2-e417-4898-8e2c-4c5e98960f9f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for user b8d05eeb8ac146969b99d33084f1664c and project 8f72940f7df74b898595c0ed9c654502. Resources: {'key_pairs'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:02:33.130028 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-01f63fa2-e417-4898-8e2c-4c5e98960f9f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114074 Jun 02 14:02:33.131019 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 434/841] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 2 14:02:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:36.189821 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-642338820", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7cd32eca-d3a3-4153-bf1f-a37e8fefca27"}], "security_groups": [{"name": "tempest-securitygroup--1220460519"}], "key_name": "tempest-keypair-2146280950", "user_data": "}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:36.313763 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.network.neutron [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] validate_networks() for [('7cd32eca-d3a3-4153-bf1f-a37e8fefca27', None, None, None, None, None)] {{(pid=118315) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 14:02:36.589255 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-351558172", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14cc21cb-4d69-474d-9628-4e979c4e6581"}], "security_groups": [{"name": "tempest-securitygroup--231551552"}], "key_name": "tempest-keypair-1145678587", "user_data": "}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:36.761236 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.network.neutron [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] validate_networks() for [('14cc21cb-4d69-474d-9628-4e979c4e6581', None, None, None, None, None)] {{(pid=118316) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 14:02:36.768226 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Flavor limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 14:02:36.768780 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Image limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 14:02:36.769276 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Flavor pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 14:02:36.769776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Image pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 14:02:36.770196 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 14:02:36.779447 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:36.779888 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:36.780713 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:36.781143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:36.798668 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Getting quotas for project fbb232ab0a2347dea2fa82e1cdbf24b5. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:02:36.803155 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Getting quotas for user 36e78feea3104797a5e927c8ffb76d18 and project fbb232ab0a2347dea2fa82e1cdbf24b5. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:02:36.814549 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Going to run 1 instances... {{(pid=118315) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 14:02:36.817406 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118315) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 14:02:36.942522 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5086833b-48b4-41ce-9ccf-fb6498e307b3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.757213 Jun 02 14:02:36.943999 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 408/842] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 14:02:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 14:02:36.955172 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-23887265-c7f3-4580-b20f-fc47c5a490d0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:36.956183 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-23887265-c7f3-4580-b20f-fc47c5a490d0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:37.087843 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-23887265-c7f3-4580-b20f-fc47c5a490d0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:37.096085 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-23887265-c7f3-4580-b20f-fc47c5a490d0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1237 microversion: 2.1 time: 0.145809 Jun 02 14:02:37.097556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 409/843] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:36 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1237 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:37.214368 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Flavor limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 14:02:37.214787 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Image limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 14:02:37.215249 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Flavor pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 14:02:37.215649 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Image pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 14:02:37.216050 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 14:02:37.225349 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:37.225791 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:37.226572 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:37.226996 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:37.244292 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for project 8f72940f7df74b898595c0ed9c654502. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:02:37.248584 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for user b8d05eeb8ac146969b99d33084f1664c and project 8f72940f7df74b898595c0ed9c654502. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:02:37.259956 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Going to run 1 instances... {{(pid=118316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 14:02:37.262623 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 14:02:37.390267 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6d3241be-5ccc-4394-89c1-3ee76669c990 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.809987 Jun 02 14:02:37.391102 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 435/844] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 14:02:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 14:02:37.401221 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a8dee5cf-4be2-4743-a7dc-4b0060b4969d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:37.401843 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a8dee5cf-4be2-4743-a7dc-4b0060b4969d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:37.462832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a8dee5cf-4be2-4743-a7dc-4b0060b4969d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:37.469635 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a8dee5cf-4be2-4743-a7dc-4b0060b4969d tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1241 microversion: 2.1 time: 0.072246 Jun 02 14:02:37.470195 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 410/845] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:37 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:38.114248 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-31250939-ba81-4488-96ff-db64bfabe010 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:38.114836 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-31250939-ba81-4488-96ff-db64bfabe010 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:38.171285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-31250939-ba81-4488-96ff-db64bfabe010 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:38.178846 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-31250939-ba81-4488-96ff-db64bfabe010 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1237 microversion: 2.1 time: 0.068700 Jun 02 14:02:38.179403 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 436/846] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:38 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:38.492636 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e6f1be2c-98cc-4a8a-8f6b-6c9fd94b37f4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:38.493813 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e6f1be2c-98cc-4a8a-8f6b-6c9fd94b37f4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:38.501110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e6f1be2c-98cc-4a8a-8f6b-6c9fd94b37f4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:38.501589 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e6f1be2c-98cc-4a8a-8f6b-6c9fd94b37f4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:38.502357 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e6f1be2c-98cc-4a8a-8f6b-6c9fd94b37f4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:38.502797 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e6f1be2c-98cc-4a8a-8f6b-6c9fd94b37f4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:38.507773 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:38.563312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e6f1be2c-98cc-4a8a-8f6b-6c9fd94b37f4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:38.571673 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e6f1be2c-98cc-4a8a-8f6b-6c9fd94b37f4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1245 microversion: 2.1 time: 0.083462 Jun 02 14:02:38.572177 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 411/847] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:38 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:39.195660 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-fe130d50-993d-4147-b5ad-c8f2c0b21388 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:39.196382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-fe130d50-993d-4147-b5ad-c8f2c0b21388 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:39.203332 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe130d50-993d-4147-b5ad-c8f2c0b21388 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:39.203783 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe130d50-993d-4147-b5ad-c8f2c0b21388 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:39.204598 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe130d50-993d-4147-b5ad-c8f2c0b21388 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:39.205082 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe130d50-993d-4147-b5ad-c8f2c0b21388 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:39.271176 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-fe130d50-993d-4147-b5ad-c8f2c0b21388 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:39.278741 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-fe130d50-993d-4147-b5ad-c8f2c0b21388 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1289 microversion: 2.1 time: 0.087026 Jun 02 14:02:39.279314 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 437/848] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:39 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:39.589483 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-093a7235-c0a3-48a7-bcf0-e6836449a5b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:39.590098 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-093a7235-c0a3-48a7-bcf0-e6836449a5b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:39.597289 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-093a7235-c0a3-48a7-bcf0-e6836449a5b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:39.597742 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-093a7235-c0a3-48a7-bcf0-e6836449a5b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:39.598501 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-093a7235-c0a3-48a7-bcf0-e6836449a5b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:39.599070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-093a7235-c0a3-48a7-bcf0-e6836449a5b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:39.662212 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-093a7235-c0a3-48a7-bcf0-e6836449a5b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:39.669803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-093a7235-c0a3-48a7-bcf0-e6836449a5b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1293 microversion: 2.1 time: 0.084263 Jun 02 14:02:39.670380 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 412/849] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:39 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:40.297386 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8cb9c304-2c49-46bc-a528-e1417e17a9a0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:40.297915 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8cb9c304-2c49-46bc-a528-e1417e17a9a0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:40.305272 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8cb9c304-2c49-46bc-a528-e1417e17a9a0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:40.305723 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8cb9c304-2c49-46bc-a528-e1417e17a9a0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:40.306496 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8cb9c304-2c49-46bc-a528-e1417e17a9a0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:40.306931 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8cb9c304-2c49-46bc-a528-e1417e17a9a0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:40.326160 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:40.375069 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8cb9c304-2c49-46bc-a528-e1417e17a9a0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:40.385302 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8cb9c304-2c49-46bc-a528-e1417e17a9a0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1295 microversion: 2.1 time: 0.091994 Jun 02 14:02:40.386155 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 438/850] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:40 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1295 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:40.687921 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2d8b1ba8-ddcc-4b04-9f5e-eca54392c6ef tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:40.688758 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-2d8b1ba8-ddcc-4b04-9f5e-eca54392c6ef tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:40.697826 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2d8b1ba8-ddcc-4b04-9f5e-eca54392c6ef tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:40.698428 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2d8b1ba8-ddcc-4b04-9f5e-eca54392c6ef tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:40.699305 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2d8b1ba8-ddcc-4b04-9f5e-eca54392c6ef tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:40.699733 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-2d8b1ba8-ddcc-4b04-9f5e-eca54392c6ef tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:40.768469 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2d8b1ba8-ddcc-4b04-9f5e-eca54392c6ef tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:40.777105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2d8b1ba8-ddcc-4b04-9f5e-eca54392c6ef tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1311 microversion: 2.1 time: 0.093204 Jun 02 14:02:40.777675 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 413/851] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:40 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:41.403053 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2782d1a5-9ce2-4c8a-b7ed-f0e7bd9615a9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:41.403585 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2782d1a5-9ce2-4c8a-b7ed-f0e7bd9615a9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:41.410789 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2782d1a5-9ce2-4c8a-b7ed-f0e7bd9615a9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:41.411232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2782d1a5-9ce2-4c8a-b7ed-f0e7bd9615a9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:41.412060 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2782d1a5-9ce2-4c8a-b7ed-f0e7bd9615a9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:41.412485 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2782d1a5-9ce2-4c8a-b7ed-f0e7bd9615a9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:41.549165 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2782d1a5-9ce2-4c8a-b7ed-f0e7bd9615a9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:41.559219 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2782d1a5-9ce2-4c8a-b7ed-f0e7bd9615a9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1363 microversion: 2.1 time: 0.159934 Jun 02 14:02:41.559809 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 439/852] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:41 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:41.795501 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-efaf46db-db42-4d23-bd9b-3979c0c45b6a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:41.796437 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-efaf46db-db42-4d23-bd9b-3979c0c45b6a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:41.803316 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-efaf46db-db42-4d23-bd9b-3979c0c45b6a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:41.806998 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-efaf46db-db42-4d23-bd9b-3979c0c45b6a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:41.806998 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-efaf46db-db42-4d23-bd9b-3979c0c45b6a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:41.806998 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-efaf46db-db42-4d23-bd9b-3979c0c45b6a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:41.946018 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-efaf46db-db42-4d23-bd9b-3979c0c45b6a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:41.956483 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-efaf46db-db42-4d23-bd9b-3979c0c45b6a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.164666 Jun 02 14:02:41.965395 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 414/853] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:41 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:42.432223 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-7bff9de2-d458-4f8a-9668-378b928b502c req-f0343490-6414-4989-97c8-1e9aefe60a8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0222076-c3be-46b9-81c2-2f88404417aa", "tag": "b85165e3-bd41-49ff-9007-f04034275503"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:42.442273 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-7bff9de2-d458-4f8a-9668-378b928b502c req-f0343490-6414-4989-97c8-1e9aefe60a8a service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:42.447913 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-7bff9de2-d458-4f8a-9668-378b928b502c req-f0343490-6414-4989-97c8-1e9aefe60a8a service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:42.471489 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-7bff9de2-d458-4f8a-9668-378b928b502c req-f0343490-6414-4989-97c8-1e9aefe60a8a service nova] Creating event network-changed:b85165e3-bd41-49ff-9007-f04034275503 for instance e0222076-c3be-46b9-81c2-2f88404417aa on hv-cinder-82651 Jun 02 14:02:42.472147 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-7bff9de2-d458-4f8a-9668-378b928b502c req-f0343490-6414-4989-97c8-1e9aefe60a8a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045039 Jun 02 14:02:42.473120 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 440/854] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:42.576645 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-503008c4-7fdd-4f43-92af-86710b22332d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:42.577520 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-503008c4-7fdd-4f43-92af-86710b22332d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:42.584250 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-503008c4-7fdd-4f43-92af-86710b22332d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:42.585025 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-503008c4-7fdd-4f43-92af-86710b22332d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:42.585972 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-503008c4-7fdd-4f43-92af-86710b22332d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:42.586568 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-503008c4-7fdd-4f43-92af-86710b22332d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:42.750793 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-503008c4-7fdd-4f43-92af-86710b22332d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:42.759244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-503008c4-7fdd-4f43-92af-86710b22332d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1363 microversion: 2.1 time: 0.186822 Jun 02 14:02:42.760458 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 415/855] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:42 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:42.974816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-56f0a7d3-1a57-4197-bb1e-10c3829ef5a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:42.975580 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-56f0a7d3-1a57-4197-bb1e-10c3829ef5a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:42.982458 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-56f0a7d3-1a57-4197-bb1e-10c3829ef5a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:42.983090 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-56f0a7d3-1a57-4197-bb1e-10c3829ef5a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:42.983863 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-56f0a7d3-1a57-4197-bb1e-10c3829ef5a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:42.984303 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-56f0a7d3-1a57-4197-bb1e-10c3829ef5a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:43.143322 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-56f0a7d3-1a57-4197-bb1e-10c3829ef5a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:43.151897 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-56f0a7d3-1a57-4197-bb1e-10c3829ef5a2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.181730 Jun 02 14:02:43.152738 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 441/856] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:42 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:43.776025 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5092906b-e18f-4082-9e40-784fe26f2b33 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:43.776712 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5092906b-e18f-4082-9e40-784fe26f2b33 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:43.783237 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5092906b-e18f-4082-9e40-784fe26f2b33 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:43.783684 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5092906b-e18f-4082-9e40-784fe26f2b33 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:43.784465 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5092906b-e18f-4082-9e40-784fe26f2b33 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:43.784898 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5092906b-e18f-4082-9e40-784fe26f2b33 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:43.918659 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5092906b-e18f-4082-9e40-784fe26f2b33 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:43.926151 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5092906b-e18f-4082-9e40-784fe26f2b33 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1363 microversion: 2.1 time: 0.153971 Jun 02 14:02:43.926720 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 416/857] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:43 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:44.169091 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9787db0d-6e39-4622-b0fc-6bf0fbdc975e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:44.169643 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9787db0d-6e39-4622-b0fc-6bf0fbdc975e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:44.175952 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9787db0d-6e39-4622-b0fc-6bf0fbdc975e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:44.176388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9787db0d-6e39-4622-b0fc-6bf0fbdc975e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:44.177984 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9787db0d-6e39-4622-b0fc-6bf0fbdc975e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:44.178416 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9787db0d-6e39-4622-b0fc-6bf0fbdc975e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:44.307921 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9787db0d-6e39-4622-b0fc-6bf0fbdc975e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:44.315266 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9787db0d-6e39-4622-b0fc-6bf0fbdc975e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.150127 Jun 02 14:02:44.315829 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 442/858] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:44 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:44.499089 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-4cadd8fa-248e-4acd-b7b0-ac79372d2e1a req-fc1343d4-b0fd-4c5a-bece-01a6ddcefea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6", "tag": "e0162a80-31b2-4445-aa2c-973d6d0f416a"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:44.507355 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-4cadd8fa-248e-4acd-b7b0-ac79372d2e1a req-fc1343d4-b0fd-4c5a-bece-01a6ddcefea4 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:44.507798 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-4cadd8fa-248e-4acd-b7b0-ac79372d2e1a req-fc1343d4-b0fd-4c5a-bece-01a6ddcefea4 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:44.518357 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-4cadd8fa-248e-4acd-b7b0-ac79372d2e1a req-fc1343d4-b0fd-4c5a-bece-01a6ddcefea4 service nova] Creating event network-changed:e0162a80-31b2-4445-aa2c-973d6d0f416a for instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 on hv-cinder-82651 Jun 02 14:02:44.523951 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-4cadd8fa-248e-4acd-b7b0-ac79372d2e1a req-fc1343d4-b0fd-4c5a-bece-01a6ddcefea4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028623 Jun 02 14:02:44.524542 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 417/859] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:44.943618 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-cbdcd1d0-a651-493e-917e-7c751f3017e0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:44.944248 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-cbdcd1d0-a651-493e-917e-7c751f3017e0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:44.950490 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cbdcd1d0-a651-493e-917e-7c751f3017e0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:44.950929 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cbdcd1d0-a651-493e-917e-7c751f3017e0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:44.951668 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cbdcd1d0-a651-493e-917e-7c751f3017e0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:44.952096 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cbdcd1d0-a651-493e-917e-7c751f3017e0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:45.094444 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-cbdcd1d0-a651-493e-917e-7c751f3017e0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:45.102278 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-cbdcd1d0-a651-493e-917e-7c751f3017e0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1363 microversion: 2.1 time: 0.163078 Jun 02 14:02:45.102845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 443/860] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:44 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:45.333750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fcaef6f0-378b-40a4-b052-6ad561f10221 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:45.334470 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-fcaef6f0-378b-40a4-b052-6ad561f10221 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:45.336501 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:45.341537 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fcaef6f0-378b-40a4-b052-6ad561f10221 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:45.342105 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fcaef6f0-378b-40a4-b052-6ad561f10221 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:45.342756 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fcaef6f0-378b-40a4-b052-6ad561f10221 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:45.343194 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fcaef6f0-378b-40a4-b052-6ad561f10221 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:45.472097 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-fcaef6f0-378b-40a4-b052-6ad561f10221 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:45.480188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-fcaef6f0-378b-40a4-b052-6ad561f10221 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.151166 Jun 02 14:02:45.480788 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 418/861] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:45 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:46.118938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-741c4495-1818-4637-b284-a5ee715da658 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:46.119490 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-741c4495-1818-4637-b284-a5ee715da658 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:46.126015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-741c4495-1818-4637-b284-a5ee715da658 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:46.126460 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-741c4495-1818-4637-b284-a5ee715da658 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:46.127211 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-741c4495-1818-4637-b284-a5ee715da658 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:46.127643 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-741c4495-1818-4637-b284-a5ee715da658 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:46.258263 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-741c4495-1818-4637-b284-a5ee715da658 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:46.265621 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-741c4495-1818-4637-b284-a5ee715da658 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1363 microversion: 2.1 time: 0.150620 Jun 02 14:02:46.266178 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 444/862] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:46 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:46.497794 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-9cef11ba-a6b5-40d3-8aa9-816e2105ab72 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:46.498405 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-9cef11ba-a6b5-40d3-8aa9-816e2105ab72 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:46.505623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9cef11ba-a6b5-40d3-8aa9-816e2105ab72 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:46.506082 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9cef11ba-a6b5-40d3-8aa9-816e2105ab72 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:46.506851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9cef11ba-a6b5-40d3-8aa9-816e2105ab72 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:46.507285 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9cef11ba-a6b5-40d3-8aa9-816e2105ab72 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:46.634432 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-9cef11ba-a6b5-40d3-8aa9-816e2105ab72 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:46.641989 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-9cef11ba-a6b5-40d3-8aa9-816e2105ab72 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.148113 Jun 02 14:02:46.642578 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 419/863] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:46 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:47.282958 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-468b1b47-9a24-40d6-b58b-04d97eb25989 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:47.283605 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-468b1b47-9a24-40d6-b58b-04d97eb25989 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:47.286176 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:47.291790 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-468b1b47-9a24-40d6-b58b-04d97eb25989 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:47.304489 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-468b1b47-9a24-40d6-b58b-04d97eb25989 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:47.304489 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-468b1b47-9a24-40d6-b58b-04d97eb25989 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:47.304489 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-468b1b47-9a24-40d6-b58b-04d97eb25989 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:47.423631 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-468b1b47-9a24-40d6-b58b-04d97eb25989 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:47.431588 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-468b1b47-9a24-40d6-b58b-04d97eb25989 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1363 microversion: 2.1 time: 0.152500 Jun 02 14:02:47.432165 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 445/864] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:47 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:47.659023 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f7bbc49c-e25d-41ae-a340-5b3a1cf24b12 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:47.659565 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f7bbc49c-e25d-41ae-a340-5b3a1cf24b12 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:47.661502 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=2 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:47.662274 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=14 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:47.667596 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f7bbc49c-e25d-41ae-a340-5b3a1cf24b12 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:47.668045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f7bbc49c-e25d-41ae-a340-5b3a1cf24b12 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:47.668853 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f7bbc49c-e25d-41ae-a340-5b3a1cf24b12 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:47.669289 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f7bbc49c-e25d-41ae-a340-5b3a1cf24b12 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:47.812896 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f7bbc49c-e25d-41ae-a340-5b3a1cf24b12 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:47.820596 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f7bbc49c-e25d-41ae-a340-5b3a1cf24b12 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.165464 Jun 02 14:02:47.821161 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 420/865] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:47 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:48.450055 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a86993db-9e58-49b2-9950-b8918a470ff1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:48.450737 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a86993db-9e58-49b2-9950-b8918a470ff1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:48.452555 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=12 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:48.458180 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a86993db-9e58-49b2-9950-b8918a470ff1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:48.458951 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a86993db-9e58-49b2-9950-b8918a470ff1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:48.459727 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a86993db-9e58-49b2-9950-b8918a470ff1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:48.460151 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a86993db-9e58-49b2-9950-b8918a470ff1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:48.589659 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a86993db-9e58-49b2-9950-b8918a470ff1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:48.597173 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a86993db-9e58-49b2-9950-b8918a470ff1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1363 microversion: 2.1 time: 0.151256 Jun 02 14:02:48.597740 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 446/866] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:48 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:48.849056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5ea0aa0d-ed81-4ca8-91c8-d380f708e12a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:48.849647 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5ea0aa0d-ed81-4ca8-91c8-d380f708e12a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:48.856707 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5ea0aa0d-ed81-4ca8-91c8-d380f708e12a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:48.857151 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5ea0aa0d-ed81-4ca8-91c8-d380f708e12a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:48.857907 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5ea0aa0d-ed81-4ca8-91c8-d380f708e12a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:48.858338 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5ea0aa0d-ed81-4ca8-91c8-d380f708e12a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:48.988114 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5ea0aa0d-ed81-4ca8-91c8-d380f708e12a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:48.996058 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5ea0aa0d-ed81-4ca8-91c8-d380f708e12a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.150927 Jun 02 14:02:48.996651 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 421/867] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:48 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:49.614122 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9c7549ba-07fe-49af-a482-74b45d0583c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:49.614814 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9c7549ba-07fe-49af-a482-74b45d0583c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:49.621402 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9c7549ba-07fe-49af-a482-74b45d0583c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:49.624682 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9c7549ba-07fe-49af-a482-74b45d0583c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:49.624682 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9c7549ba-07fe-49af-a482-74b45d0583c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:49.624682 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9c7549ba-07fe-49af-a482-74b45d0583c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:49.759522 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9c7549ba-07fe-49af-a482-74b45d0583c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:49.767035 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9c7549ba-07fe-49af-a482-74b45d0583c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1363 microversion: 2.1 time: 0.156812 Jun 02 14:02:49.767610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 447/868] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:49 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:50.012987 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-26e522cb-a8c6-4a74-ad09-261bf0dcf13f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:50.013598 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-26e522cb-a8c6-4a74-ad09-261bf0dcf13f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:50.020048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-26e522cb-a8c6-4a74-ad09-261bf0dcf13f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:50.021297 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-26e522cb-a8c6-4a74-ad09-261bf0dcf13f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:50.022264 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-26e522cb-a8c6-4a74-ad09-261bf0dcf13f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:50.022688 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-26e522cb-a8c6-4a74-ad09-261bf0dcf13f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:50.149675 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-26e522cb-a8c6-4a74-ad09-261bf0dcf13f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:50.157038 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-26e522cb-a8c6-4a74-ad09-261bf0dcf13f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.147982 Jun 02 14:02:50.157660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 422/869] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:50 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:50.784489 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-dfe03b0a-b783-440b-bc76-ad8694576166 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:50.785153 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-dfe03b0a-b783-440b-bc76-ad8694576166 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:50.792448 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dfe03b0a-b783-440b-bc76-ad8694576166 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:50.792891 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dfe03b0a-b783-440b-bc76-ad8694576166 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:50.793638 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dfe03b0a-b783-440b-bc76-ad8694576166 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:50.794060 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dfe03b0a-b783-440b-bc76-ad8694576166 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:50.925102 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-dfe03b0a-b783-440b-bc76-ad8694576166 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:50.932691 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-dfe03b0a-b783-440b-bc76-ad8694576166 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1363 microversion: 2.1 time: 0.151986 Jun 02 14:02:50.933472 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 448/870] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:50 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:51.174494 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f3e29625-ca4e-4935-88bf-da3fec236fdd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:51.175069 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f3e29625-ca4e-4935-88bf-da3fec236fdd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:51.181632 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f3e29625-ca4e-4935-88bf-da3fec236fdd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:51.182073 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f3e29625-ca4e-4935-88bf-da3fec236fdd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:51.182818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f3e29625-ca4e-4935-88bf-da3fec236fdd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:51.183243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f3e29625-ca4e-4935-88bf-da3fec236fdd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:51.310190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f3e29625-ca4e-4935-88bf-da3fec236fdd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:51.317670 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f3e29625-ca4e-4935-88bf-da3fec236fdd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.147149 Jun 02 14:02:51.318239 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 423/871] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:51 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:51.950826 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8b9a24a5-b2e6-4f60-b015-d7898058d160 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:51.951429 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8b9a24a5-b2e6-4f60-b015-d7898058d160 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:51.960306 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8b9a24a5-b2e6-4f60-b015-d7898058d160 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:51.960861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8b9a24a5-b2e6-4f60-b015-d7898058d160 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:51.961644 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8b9a24a5-b2e6-4f60-b015-d7898058d160 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:51.962104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8b9a24a5-b2e6-4f60-b015-d7898058d160 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:52.056307 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-ad919553-59f1-475f-a599-14ed3fcf2947 req-c6c7b22a-d2dc-4c24-85ee-725a134f1d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0222076-c3be-46b9-81c2-2f88404417aa", "name": "network-vif-plugged", "status": "completed", "tag": "b85165e3-bd41-49ff-9007-f04034275503"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:52.066103 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-ad919553-59f1-475f-a599-14ed3fcf2947 req-c6c7b22a-d2dc-4c24-85ee-725a134f1d31 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:52.066939 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-ad919553-59f1-475f-a599-14ed3fcf2947 req-c6c7b22a-d2dc-4c24-85ee-725a134f1d31 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:52.079873 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-ad919553-59f1-475f-a599-14ed3fcf2947 req-c6c7b22a-d2dc-4c24-85ee-725a134f1d31 service nova] Creating event network-vif-plugged:b85165e3-bd41-49ff-9007-f04034275503 for instance e0222076-c3be-46b9-81c2-2f88404417aa on hv-cinder-82651 Jun 02 14:02:52.087647 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-ad919553-59f1-475f-a599-14ed3fcf2947 req-c6c7b22a-d2dc-4c24-85ee-725a134f1d31 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039359 Jun 02 14:02:52.088870 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 424/872] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:52.110070 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8b9a24a5-b2e6-4f60-b015-d7898058d160 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:52.118200 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8b9a24a5-b2e6-4f60-b015-d7898058d160 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1363 microversion: 2.1 time: 0.171458 Jun 02 14:02:52.119067 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 449/873] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:51 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:52.343992 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-cbbbacaa-d3cd-40f8-b26f-74d7e87ea707 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:52.344676 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-cbbbacaa-d3cd-40f8-b26f-74d7e87ea707 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:52.352215 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cbbbacaa-d3cd-40f8-b26f-74d7e87ea707 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:52.352695 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cbbbacaa-d3cd-40f8-b26f-74d7e87ea707 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:52.353467 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cbbbacaa-d3cd-40f8-b26f-74d7e87ea707 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:52.353906 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cbbbacaa-d3cd-40f8-b26f-74d7e87ea707 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:52.491921 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-cbbbacaa-d3cd-40f8-b26f-74d7e87ea707 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:52.499882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-cbbbacaa-d3cd-40f8-b26f-74d7e87ea707 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.160373 Jun 02 14:02:52.500793 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 425/874] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:52 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:53.135903 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-fdfb98f1-73f5-40fc-8973-8529558a9eef tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:53.136457 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-fdfb98f1-73f5-40fc-8973-8529558a9eef tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:53.144551 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fdfb98f1-73f5-40fc-8973-8529558a9eef tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:53.146528 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fdfb98f1-73f5-40fc-8973-8529558a9eef tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:53.146528 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fdfb98f1-73f5-40fc-8973-8529558a9eef tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:53.146528 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fdfb98f1-73f5-40fc-8973-8529558a9eef tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:53.280960 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-fdfb98f1-73f5-40fc-8973-8529558a9eef tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:53.288693 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-fdfb98f1-73f5-40fc-8973-8529558a9eef tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1363 microversion: 2.1 time: 0.157492 Jun 02 14:02:53.289248 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 450/875] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:53 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:53.515886 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-541ffb6c-bb74-4c5b-a19b-38816002c4b5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:53.516533 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-541ffb6c-bb74-4c5b-a19b-38816002c4b5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:53.523084 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-541ffb6c-bb74-4c5b-a19b-38816002c4b5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:53.523518 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-541ffb6c-bb74-4c5b-a19b-38816002c4b5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:53.524265 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-541ffb6c-bb74-4c5b-a19b-38816002c4b5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:53.524727 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-541ffb6c-bb74-4c5b-a19b-38816002c4b5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:53.650661 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-541ffb6c-bb74-4c5b-a19b-38816002c4b5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:53.657979 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-541ffb6c-bb74-4c5b-a19b-38816002c4b5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.145926 Jun 02 14:02:53.658534 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 426/876] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:53 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:54.306052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8e3a32ed-9c73-4f49-953c-0b9d6701c1b1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:54.306694 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8e3a32ed-9c73-4f49-953c-0b9d6701c1b1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:54.313208 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e3a32ed-9c73-4f49-953c-0b9d6701c1b1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:54.313650 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e3a32ed-9c73-4f49-953c-0b9d6701c1b1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:54.314466 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e3a32ed-9c73-4f49-953c-0b9d6701c1b1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:54.314898 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e3a32ed-9c73-4f49-953c-0b9d6701c1b1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:54.444654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8e3a32ed-9c73-4f49-953c-0b9d6701c1b1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:54.452328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8e3a32ed-9c73-4f49-953c-0b9d6701c1b1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1363 microversion: 2.1 time: 0.150767 Jun 02 14:02:54.453013 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 451/877] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:54 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:54.526919 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-67d4ede0-8860-4425-ba10-f314b90f56cb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1162069593"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:54.527480 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-67d4ede0-8860-4425-ba10-f314b90f56cb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:54.534125 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-67d4ede0-8860-4425-ba10-f314b90f56cb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:54.534575 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-67d4ede0-8860-4425-ba10-f314b90f56cb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:54.535341 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-67d4ede0-8860-4425-ba10-f314b90f56cb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:54.535777 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-67d4ede0-8860-4425-ba10-f314b90f56cb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:54.670634 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.network.security_group_api [None req-67d4ede0-8860-4425-ba10-f314b90f56cb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Removing security group 6d528ef8-9e7d-4c25-8221-803e6b1ecc46 from port 206884cb-c7bb-4476-9320-75dc2245d246 Jun 02 14:02:54.675891 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5f5eb04b-17b4-4cd2-8e0f-959ed9635703 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:54.676536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-5f5eb04b-17b4-4cd2-8e0f-959ed9635703 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:54.683168 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5f5eb04b-17b4-4cd2-8e0f-959ed9635703 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:54.683624 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5f5eb04b-17b4-4cd2-8e0f-959ed9635703 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:54.684387 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5f5eb04b-17b4-4cd2-8e0f-959ed9635703 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:54.684864 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5f5eb04b-17b4-4cd2-8e0f-959ed9635703 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:54.903377 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5f5eb04b-17b4-4cd2-8e0f-959ed9635703 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:54.910834 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5f5eb04b-17b4-4cd2-8e0f-959ed9635703 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.238802 Jun 02 14:02:54.911418 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 452/878] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:54 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:55.217492 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-67d4ede0-8860-4425-ba10-f314b90f56cb tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "POST /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/action" status: 202 len: 0 microversion: 2.1 time: 0.695830 Jun 02 14:02:55.218121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 427/879] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 2 14:02:54 2022] POST /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/action => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:02:55.228728 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-8ff1f626-0670-4065-b34e-f27b9a6369e6 req-96397b35-94cf-425e-bb89-4f1de0bc2917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "783eae57-62e0-4101-ae12-14b73c9f87db", "tag": "206884cb-c7bb-4476-9320-75dc2245d246"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:55.237121 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-8ff1f626-0670-4065-b34e-f27b9a6369e6 req-96397b35-94cf-425e-bb89-4f1de0bc2917 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:55.237652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-8ff1f626-0670-4065-b34e-f27b9a6369e6 req-96397b35-94cf-425e-bb89-4f1de0bc2917 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:55.260001 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-8ff1f626-0670-4065-b34e-f27b9a6369e6 req-96397b35-94cf-425e-bb89-4f1de0bc2917 service nova] Creating event network-changed:206884cb-c7bb-4476-9320-75dc2245d246 for instance 783eae57-62e0-4101-ae12-14b73c9f87db on hv-cinder-82651 Jun 02 14:02:55.265410 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-8ff1f626-0670-4065-b34e-f27b9a6369e6 req-96397b35-94cf-425e-bb89-4f1de0bc2917 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041087 Jun 02 14:02:55.266505 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 453/880] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:55.470112 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5e280dfd-cc9f-43fd-82bc-9f0c0b288d64 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:55.471014 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5e280dfd-cc9f-43fd-82bc-9f0c0b288d64 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:55.477718 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5e280dfd-cc9f-43fd-82bc-9f0c0b288d64 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:55.478591 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5e280dfd-cc9f-43fd-82bc-9f0c0b288d64 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:55.479527 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5e280dfd-cc9f-43fd-82bc-9f0c0b288d64 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:55.479959 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5e280dfd-cc9f-43fd-82bc-9f0c0b288d64 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:55.736529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5e280dfd-cc9f-43fd-82bc-9f0c0b288d64 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:55.745632 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5e280dfd-cc9f-43fd-82bc-9f0c0b288d64 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1549 microversion: 2.1 time: 0.279325 Jun 02 14:02:55.746353 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 428/881] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:55 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1549 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:55.769360 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4e98e4bc-08fb-4f56-812c-6c0b89297758 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:55.769937 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4e98e4bc-08fb-4f56-812c-6c0b89297758 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:55.777051 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4e98e4bc-08fb-4f56-812c-6c0b89297758 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:55.777777 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4e98e4bc-08fb-4f56-812c-6c0b89297758 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:55.778562 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4e98e4bc-08fb-4f56-812c-6c0b89297758 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:55.778990 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4e98e4bc-08fb-4f56-812c-6c0b89297758 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:55.927322 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e0456bb4-346c-456c-88d8-ef465dc5caff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:55.928624 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e0456bb4-346c-456c-88d8-ef465dc5caff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:55.935644 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e0456bb4-346c-456c-88d8-ef465dc5caff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:55.936097 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e0456bb4-346c-456c-88d8-ef465dc5caff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:55.936908 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e0456bb4-346c-456c-88d8-ef465dc5caff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:55.937346 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e0456bb4-346c-456c-88d8-ef465dc5caff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:55.957791 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=100 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:56.142749 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4e98e4bc-08fb-4f56-812c-6c0b89297758 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.377492 Jun 02 14:02:56.143331 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 454/882] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 2 14:02:55 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/os-interface => generated 285 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:56.377376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e0456bb4-346c-456c-88d8-ef465dc5caff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:56.387421 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e0456bb4-346c-456c-88d8-ef465dc5caff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.464017 Jun 02 14:02:56.388577 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 429/883] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:55 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:02:56.766024 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-3f027093-2c4d-44da-9223-9d1bdce6d721 req-f867d031-c6ac-4d01-8ea0-c87a079f4550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6", "name": "network-vif-plugged", "status": "completed", "tag": "e0162a80-31b2-4445-aa2c-973d6d0f416a"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:56.775509 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-3f027093-2c4d-44da-9223-9d1bdce6d721 req-f867d031-c6ac-4d01-8ea0-c87a079f4550 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:56.776098 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-3f027093-2c4d-44da-9223-9d1bdce6d721 req-f867d031-c6ac-4d01-8ea0-c87a079f4550 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:56.787547 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-3f027093-2c4d-44da-9223-9d1bdce6d721 req-f867d031-c6ac-4d01-8ea0-c87a079f4550 service nova] Creating event network-vif-plugged:e0162a80-31b2-4445-aa2c-973d6d0f416a for instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 on hv-cinder-82651 Jun 02 14:02:56.792433 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-3f027093-2c4d-44da-9223-9d1bdce6d721 req-f867d031-c6ac-4d01-8ea0-c87a079f4550 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030065 Jun 02 14:02:56.793083 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 455/884] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:57.405516 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-686efb82-0803-4173-9f9b-3f1fa44aab3e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:57.406121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-686efb82-0803-4173-9f9b-3f1fa44aab3e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:57.413375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-686efb82-0803-4173-9f9b-3f1fa44aab3e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:57.413923 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-686efb82-0803-4173-9f9b-3f1fa44aab3e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:57.414684 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-686efb82-0803-4173-9f9b-3f1fa44aab3e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:57.415302 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-686efb82-0803-4173-9f9b-3f1fa44aab3e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:57.559881 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-56c5736e-25f1-4d0c-aab7-677fc53da7d0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:57.563436 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-56c5736e-25f1-4d0c-aab7-677fc53da7d0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:57.586559 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-56c5736e-25f1-4d0c-aab7-677fc53da7d0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:57.587002 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-56c5736e-25f1-4d0c-aab7-677fc53da7d0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:57.588502 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-56c5736e-25f1-4d0c-aab7-677fc53da7d0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:57.588502 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-56c5736e-25f1-4d0c-aab7-677fc53da7d0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:57.683519 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-56c5736e-25f1-4d0c-aab7-677fc53da7d0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lazy-loading 'services' on Instance uuid 783eae57-62e0-4101-ae12-14b73c9f87db {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:02:57.835754 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:57.932765 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-56c5736e-25f1-4d0c-aab7-677fc53da7d0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "DELETE /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments/049400a3-fe28-4366-9672-1276585d0905" status: 202 len: 0 microversion: 2.1 time: 0.378794 Jun 02 14:02:57.936656 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 456/885] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 2 14:02:57 2022] DELETE /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments/049400a3-fe28-4366-9672-1276585d0905 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:02:57.936850 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-686efb82-0803-4173-9f9b-3f1fa44aab3e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:57.944007 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-cc3eac07-b345-4773-9492-50457ebfcd4a req-0ce19d4c-70d3-4189-93c7-13a6ba3ff989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "783eae57-62e0-4101-ae12-14b73c9f87db", "tag": "206884cb-c7bb-4476-9320-75dc2245d246"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:02:57.956887 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-686efb82-0803-4173-9f9b-3f1fa44aab3e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.555192 Jun 02 14:02:57.958041 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 430/886] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:57 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:02:57.963741 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4ee23ed1-6566-4181-a5a8-0a8e4ce4d6b3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:57.965672 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4ee23ed1-6566-4181-a5a8-0a8e4ce4d6b3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:57.976946 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4ee23ed1-6566-4181-a5a8-0a8e4ce4d6b3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:57.977399 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4ee23ed1-6566-4181-a5a8-0a8e4ce4d6b3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:57.979417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-cc3eac07-b345-4773-9492-50457ebfcd4a req-0ce19d4c-70d3-4189-93c7-13a6ba3ff989 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:57.979875 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-cc3eac07-b345-4773-9492-50457ebfcd4a req-0ce19d4c-70d3-4189-93c7-13a6ba3ff989 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:57.981882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4ee23ed1-6566-4181-a5a8-0a8e4ce4d6b3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:57.982345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4ee23ed1-6566-4181-a5a8-0a8e4ce4d6b3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:57.994591 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-cc3eac07-b345-4773-9492-50457ebfcd4a req-0ce19d4c-70d3-4189-93c7-13a6ba3ff989 service nova] Creating event network-changed:206884cb-c7bb-4476-9320-75dc2245d246 for instance 783eae57-62e0-4101-ae12-14b73c9f87db on hv-cinder-82651 Jun 02 14:02:57.999546 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-cc3eac07-b345-4773-9492-50457ebfcd4a req-0ce19d4c-70d3-4189-93c7-13a6ba3ff989 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061089 Jun 02 14:02:58.000210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 457/887] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:58.018288 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4ee23ed1-6566-4181-a5a8-0a8e4ce4d6b3 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058727 Jun 02 14:02:58.020451 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 431/888] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:02:57 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:58.976422 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8733cb26-5636-4d70-8c54-281823fc7d26 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:58.977677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8733cb26-5636-4d70-8c54-281823fc7d26 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:58.985887 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8733cb26-5636-4d70-8c54-281823fc7d26 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:58.986886 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8733cb26-5636-4d70-8c54-281823fc7d26 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:58.987897 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8733cb26-5636-4d70-8c54-281823fc7d26 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:58.988331 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8733cb26-5636-4d70-8c54-281823fc7d26 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:59.035910 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-80c60e57-0a70-45cf-93e0-7307fa169085 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:02:59.036960 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-80c60e57-0a70-45cf-93e0-7307fa169085 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:02:59.043325 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-80c60e57-0a70-45cf-93e0-7307fa169085 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:59.043857 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-80c60e57-0a70-45cf-93e0-7307fa169085 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:59.044718 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-80c60e57-0a70-45cf-93e0-7307fa169085 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:02:59.045224 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-80c60e57-0a70-45cf-93e0-7307fa169085 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:02:59.076943 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-80c60e57-0a70-45cf-93e0-7307fa169085 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049561 Jun 02 14:02:59.077615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 432/889] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:02:59 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:02:59.156618 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8733cb26-5636-4d70-8c54-281823fc7d26 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:02:59.165124 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8733cb26-5636-4d70-8c54-281823fc7d26 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1366 microversion: 2.1 time: 0.194857 Jun 02 14:02:59.165906 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 458/890] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:02:58 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:03:00.014484 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-e43eec35-5fe4-498f-89dd-9915604e9369 req-6c6f0a44-68ec-4571-a24d-2f2af65d0859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0222076-c3be-46b9-81c2-2f88404417aa", "tag": "b85165e3-bd41-49ff-9007-f04034275503"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:03:00.023083 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-e43eec35-5fe4-498f-89dd-9915604e9369 req-6c6f0a44-68ec-4571-a24d-2f2af65d0859 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:00.023526 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-e43eec35-5fe4-498f-89dd-9915604e9369 req-6c6f0a44-68ec-4571-a24d-2f2af65d0859 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:00.034438 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-e43eec35-5fe4-498f-89dd-9915604e9369 req-6c6f0a44-68ec-4571-a24d-2f2af65d0859 service nova] Creating event network-changed:b85165e3-bd41-49ff-9007-f04034275503 for instance e0222076-c3be-46b9-81c2-2f88404417aa on hv-cinder-82651 Jun 02 14:03:00.040351 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-e43eec35-5fe4-498f-89dd-9915604e9369 req-6c6f0a44-68ec-4571-a24d-2f2af65d0859 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029589 Jun 02 14:03:00.040982 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 433/891] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:03:00.088785 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3882ed77-1dfa-471f-9496-2746ce89228b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:03:00.089703 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3882ed77-1dfa-471f-9496-2746ce89228b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:03:00.096068 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3882ed77-1dfa-471f-9496-2746ce89228b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:00.096541 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3882ed77-1dfa-471f-9496-2746ce89228b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:00.097290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3882ed77-1dfa-471f-9496-2746ce89228b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:00.097716 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3882ed77-1dfa-471f-9496-2746ce89228b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:00.127442 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3882ed77-1dfa-471f-9496-2746ce89228b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042675 Jun 02 14:03:00.127915 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 459/892] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:03:00 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:03:00.183242 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-301a8695-e196-427f-a36a-eaba29fefc05 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:03:00.183963 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-301a8695-e196-427f-a36a-eaba29fefc05 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:03:00.190379 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-301a8695-e196-427f-a36a-eaba29fefc05 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:00.190829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-301a8695-e196-427f-a36a-eaba29fefc05 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:00.191590 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-301a8695-e196-427f-a36a-eaba29fefc05 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:00.192024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-301a8695-e196-427f-a36a-eaba29fefc05 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:00.324631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-301a8695-e196-427f-a36a-eaba29fefc05 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:03:00.332290 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-301a8695-e196-427f-a36a-eaba29fefc05 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1556 microversion: 2.1 time: 0.153735 Jun 02 14:03:00.332969 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 434/893] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:03:00 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:03:00.351041 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7f313482-81fc-4eac-8b79-fb04f3256d1c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:03:00.351532 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7f313482-81fc-4eac-8b79-fb04f3256d1c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:03:00.358595 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7f313482-81fc-4eac-8b79-fb04f3256d1c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:00.359039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7f313482-81fc-4eac-8b79-fb04f3256d1c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:00.359900 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7f313482-81fc-4eac-8b79-fb04f3256d1c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:00.360333 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7f313482-81fc-4eac-8b79-fb04f3256d1c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:00.444592 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7f313482-81fc-4eac-8b79-fb04f3256d1c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096420 Jun 02 14:03:00.451620 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 460/894] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 2 14:03:00 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:03:01.138842 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1f000885-70b0-4ab7-b260-59163ff7cb7d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:03:01.139768 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1f000885-70b0-4ab7-b260-59163ff7cb7d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:03:01.145778 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1f000885-70b0-4ab7-b260-59163ff7cb7d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:01.146216 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1f000885-70b0-4ab7-b260-59163ff7cb7d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:01.147007 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1f000885-70b0-4ab7-b260-59163ff7cb7d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:01.147657 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1f000885-70b0-4ab7-b260-59163ff7cb7d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:01.181119 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1f000885-70b0-4ab7-b260-59163ff7cb7d tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046198 Jun 02 14:03:01.182074 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 435/895] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:03:01 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 14:03:01.191960 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4ee8f99c-17af-4d79-b12d-00c24e3e695a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:03:01.192514 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4ee8f99c-17af-4d79-b12d-00c24e3e695a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:03:01.199073 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4ee8f99c-17af-4d79-b12d-00c24e3e695a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:01.199520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4ee8f99c-17af-4d79-b12d-00c24e3e695a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:01.200283 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4ee8f99c-17af-4d79-b12d-00c24e3e695a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:01.200742 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4ee8f99c-17af-4d79-b12d-00c24e3e695a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:01.280834 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-4ee8f99c-17af-4d79-b12d-00c24e3e695a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] HTTP exception thrown: Instance 783eae57-62e0-4101-ae12-14b73c9f87db is not attached to volume 049400a3-fe28-4366-9672-1276585d0905 Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4ee8f99c-17af-4d79-b12d-00c24e3e695a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Request method failure captured: Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: DELETE /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments/049400a3-fe28-4366-9672-1276585d0905 HTTP/1.1 Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMHmDpXe2dHmGWGLwWgt4xAa82HTnjoUqAjHxT0cF4z-2P6Aw8TxqZu4CHsptbxl5OTbY58Ln7tQ2Zoy9tiIvzzRxnuj8lh_x4Sdz7EUAiSbbtzqrrcGYF4KWPTYCYcAELAqvMuIjMtmEFH-iukxDRzxBje5JpFxVFoV8P3Ye-rbFqs Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 93c4473545ff46bbaa857263e85af2f1 Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-TestMinimumBasicScenario-553733359 Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:03:01.289288 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:03:01.291104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_93c4473545ff46bbaa857263e85af2f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93c4473545ff46bbaa857263e85af2f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93c4473545ff46bbaa857263e85af2f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/93c4473545ff46bbaa857263e85af2f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:03:01.291104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-TestMinimumBasicScenario-553733359 Jun 02 14:03:01.291104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 93c4473545ff46bbaa857263e85af2f1 Jun 02 14:03:01.291104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-TestMinimumBasicScenario-553733359 Jun 02 14:03:01.291104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-TestMinimumBasicScenario-553733359-project Jun 02 14:03:01.291104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:03:01.291104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:03:01.291104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 3c80d109325d4a4b9e9e97dfaccc5785 Jun 02 14:03:01.291104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-TestMinimumBasicScenario-553733359-project Jun 02 14:03:01.291104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:03:01.291104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance 783eae57-62e0-4101-ae12-14b73c9f87db is not attached to volume 049400a3-fe28-4366-9672-1276585d0905 Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'server_id': '783eae57-62e0-4101-ae12-14b73c9f87db', 'id': '049400a3-fe28-4366-9672-1276585d0905'} Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 049400a3-fe28-4366-9672-1276585d0905. Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:03:01.291965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 783eae57-62e0-4101-ae12-14b73c9f87db is not attached to volume 049400a3-fe28-4366-9672-1276585d0905 Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 783eae57-62e0-4101-ae12-14b73c9f87db is not attached to volume 049400a3-fe28-4366-9672-1276585d0905 Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:03:01.293506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4ee8f99c-17af-4d79-b12d-00c24e3e695a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Returning 404 to user: Instance 783eae57-62e0-4101-ae12-14b73c9f87db is not attached to volume 049400a3-fe28-4366-9672-1276585d0905 {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:03:01.294679 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4ee8f99c-17af-4d79-b12d-00c24e3e695a tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "DELETE /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments/049400a3-fe28-4366-9672-1276585d0905" status: 404 len: 154 microversion: 2.1 time: 0.103534 Jun 02 14:03:01.295195 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 461/896] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 2 14:03:01 2022] DELETE /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db/os-volume_attachments/049400a3-fe28-4366-9672-1276585d0905 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 14:03:02.147466 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-9dd5b18c-a8be-4a8e-bac6-fe50c14d13a2 req-a37ecbaf-aa7e-4b5b-9f58-abd4fb794fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6", "tag": "e0162a80-31b2-4445-aa2c-973d6d0f416a"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:03:02.156313 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-9dd5b18c-a8be-4a8e-bac6-fe50c14d13a2 req-a37ecbaf-aa7e-4b5b-9f58-abd4fb794fa5 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:02.156795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-9dd5b18c-a8be-4a8e-bac6-fe50c14d13a2 req-a37ecbaf-aa7e-4b5b-9f58-abd4fb794fa5 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:02.168902 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-9dd5b18c-a8be-4a8e-bac6-fe50c14d13a2 req-a37ecbaf-aa7e-4b5b-9f58-abd4fb794fa5 service nova] Creating event network-changed:e0162a80-31b2-4445-aa2c-973d6d0f416a for instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 on hv-cinder-82651 Jun 02 14:03:02.173933 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-9dd5b18c-a8be-4a8e-bac6-fe50c14d13a2 req-a37ecbaf-aa7e-4b5b-9f58-abd4fb794fa5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031306 Jun 02 14:03:02.174726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 436/897] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:03:02.584677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c07f8b34-2b13-4d1d-a231-35250636fed0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:03:02.585199 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c07f8b34-2b13-4d1d-a231-35250636fed0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:03:02.587566 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:02.592971 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c07f8b34-2b13-4d1d-a231-35250636fed0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:02.593418 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c07f8b34-2b13-4d1d-a231-35250636fed0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:02.594210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c07f8b34-2b13-4d1d-a231-35250636fed0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:02.594632 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c07f8b34-2b13-4d1d-a231-35250636fed0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:02.620521 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c07f8b34-2b13-4d1d-a231-35250636fed0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Going to try to terminate instance {{(pid=118316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:03:02.915635 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c07f8b34-2b13-4d1d-a231-35250636fed0 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "DELETE /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 204 len: 0 microversion: 2.1 time: 0.334983 Jun 02 14:03:02.916309 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 462/898] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:03:02 2022] DELETE /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:03:02.925345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d3c60a5b-d251-4947-95ef-2a798cb6cf79 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:03:02.926116 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d3c60a5b-d251-4947-95ef-2a798cb6cf79 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:03:02.943308 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3c60a5b-d251-4947-95ef-2a798cb6cf79 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:02.944025 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3c60a5b-d251-4947-95ef-2a798cb6cf79 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:02.944832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3c60a5b-d251-4947-95ef-2a798cb6cf79 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:02.945878 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3c60a5b-d251-4947-95ef-2a798cb6cf79 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:03.082518 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d3c60a5b-d251-4947-95ef-2a798cb6cf79 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:03:03.090791 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d3c60a5b-d251-4947-95ef-2a798cb6cf79 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1554 microversion: 2.1 time: 0.169582 Jun 02 14:03:03.091819 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 437/899] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:03:02 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:03:04.109323 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c7bd4f9b-dae3-43e8-8b5b-0f559c07943b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:03:04.110018 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c7bd4f9b-dae3-43e8-8b5b-0f559c07943b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:03:04.116884 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c7bd4f9b-dae3-43e8-8b5b-0f559c07943b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:04.117333 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c7bd4f9b-dae3-43e8-8b5b-0f559c07943b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:04.118098 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c7bd4f9b-dae3-43e8-8b5b-0f559c07943b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:04.118532 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c7bd4f9b-dae3-43e8-8b5b-0f559c07943b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:04.254986 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c7bd4f9b-dae3-43e8-8b5b-0f559c07943b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:03:04.266098 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c7bd4f9b-dae3-43e8-8b5b-0f559c07943b tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1554 microversion: 2.1 time: 0.158296 Jun 02 14:03:04.266098 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 463/900] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:03:04 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:03:05.281037 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-336cd7f6-48c2-4da8-8f26-86a9e5ab4422 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:03:05.281631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-336cd7f6-48c2-4da8-8f26-86a9e5ab4422 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:03:05.289399 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-336cd7f6-48c2-4da8-8f26-86a9e5ab4422 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:05.289850 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-336cd7f6-48c2-4da8-8f26-86a9e5ab4422 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:05.290608 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-336cd7f6-48c2-4da8-8f26-86a9e5ab4422 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:05.291040 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-336cd7f6-48c2-4da8-8f26-86a9e5ab4422 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:05.418697 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-336cd7f6-48c2-4da8-8f26-86a9e5ab4422 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:03:05.426372 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-336cd7f6-48c2-4da8-8f26-86a9e5ab4422 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1554 microversion: 2.1 time: 0.149312 Jun 02 14:03:05.431290 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 438/901] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:03:05 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:03:06.056280 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-3969bcdf-378f-4bea-8658-be1c8554b2bb req-1904dcd4-25d4-4550-b31f-d4d98ad76652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "783eae57-62e0-4101-ae12-14b73c9f87db", "name": "network-vif-deleted", "tag": "206884cb-c7bb-4476-9320-75dc2245d246"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:03:06.064774 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-3969bcdf-378f-4bea-8658-be1c8554b2bb req-1904dcd4-25d4-4550-b31f-d4d98ad76652 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:06.071206 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-3969bcdf-378f-4bea-8658-be1c8554b2bb req-1904dcd4-25d4-4550-b31f-d4d98ad76652 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:06.077308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-3969bcdf-378f-4bea-8658-be1c8554b2bb req-1904dcd4-25d4-4550-b31f-d4d98ad76652 service nova] Creating event network-vif-deleted:206884cb-c7bb-4476-9320-75dc2245d246 for instance 783eae57-62e0-4101-ae12-14b73c9f87db on hv-cinder-82651 Jun 02 14:03:06.082160 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-3969bcdf-378f-4bea-8658-be1c8554b2bb req-1904dcd4-25d4-4550-b31f-d4d98ad76652 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030074 Jun 02 14:03:06.082780 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 464/902] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:03:06.558450 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f671fbae-1727-4fd0-8d81-d8cdabe3d184 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:03:06.559159 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f671fbae-1727-4fd0-8d81-d8cdabe3d184 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:03:06.565439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f671fbae-1727-4fd0-8d81-d8cdabe3d184 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:06.565888 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f671fbae-1727-4fd0-8d81-d8cdabe3d184 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:06.566650 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f671fbae-1727-4fd0-8d81-d8cdabe3d184 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:06.567087 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f671fbae-1727-4fd0-8d81-d8cdabe3d184 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:06.597091 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f671fbae-1727-4fd0-8d81-d8cdabe3d184 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:06.597444 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f671fbae-1727-4fd0-8d81-d8cdabe3d184 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:06.597894 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-f671fbae-1727-4fd0-8d81-d8cdabe3d184 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lazy-loading 'fault' on Instance uuid 783eae57-62e0-4101-ae12-14b73c9f87db {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:03:06.638302 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f671fbae-1727-4fd0-8d81-d8cdabe3d184 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c80d109325d4a4b9e9e97dfaccc5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4473545ff46bbaa857263e85af2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:03:06.645771 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f671fbae-1727-4fd0-8d81-d8cdabe3d184 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 200 len: 1349 microversion: 2.1 time: 0.206082 Jun 02 14:03:06.646337 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 439/903] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:03:06 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 1349 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:03:07.664611 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-74f1074a-b56e-47f4-8311-bd759d2f2192 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:03:07.665303 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-74f1074a-b56e-47f4-8311-bd759d2f2192 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] [instance: 783eae57-62e0-4101-ae12-14b73c9f87db] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:03:07.671448 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-74f1074a-b56e-47f4-8311-bd759d2f2192 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:07.671891 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-74f1074a-b56e-47f4-8311-bd759d2f2192 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:07.672697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-74f1074a-b56e-47f4-8311-bd759d2f2192 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:07.673121 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-74f1074a-b56e-47f4-8311-bd759d2f2192 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:07.686550 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-74f1074a-b56e-47f4-8311-bd759d2f2192 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] HTTP exception thrown: Instance 783eae57-62e0-4101-ae12-14b73c9f87db could not be found. Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-74f1074a-b56e-47f4-8311-bd759d2f2192 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Request method failure captured: Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db HTTP/1.1 Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMHmDpXe2dHmGWGLwWgt4xAa82HTnjoUqAjHxT0cF4z-2P6Aw8TxqZu4CHsptbxl5OTbY58Ln7tQ2Zoy9tiIvzzRxnuj8lh_x4Sdz7EUAiSbbtzqrrcGYF4KWPTYCYcAELAqvMuIjMtmEFH-iukxDRzxBje5JpFxVFoV8P3Ye-rbFqs Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 93c4473545ff46bbaa857263e85af2f1 Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-TestMinimumBasicScenario-553733359 Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:03:07.688116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:03:07.689746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_93c4473545ff46bbaa857263e85af2f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93c4473545ff46bbaa857263e85af2f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93c4473545ff46bbaa857263e85af2f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/93c4473545ff46bbaa857263e85af2f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:03:07.689746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-TestMinimumBasicScenario-553733359 Jun 02 14:03:07.689746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 93c4473545ff46bbaa857263e85af2f1 Jun 02 14:03:07.689746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-TestMinimumBasicScenario-553733359 Jun 02 14:03:07.689746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-TestMinimumBasicScenario-553733359-project Jun 02 14:03:07.689746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:03:07.689746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:03:07.689746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 3c80d109325d4a4b9e9e97dfaccc5785 Jun 02 14:03:07.689746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-TestMinimumBasicScenario-553733359-project Jun 02 14:03:07.689746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:03:07.689746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance 783eae57-62e0-4101-ae12-14b73c9f87db could not be found. Jun 02 14:03:07.689746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': '783eae57-62e0-4101-ae12-14b73c9f87db'} Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 783eae57-62e0-4101-ae12-14b73c9f87db could not be found. Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:03:07.690589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 783eae57-62e0-4101-ae12-14b73c9f87db could not be found. Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 783eae57-62e0-4101-ae12-14b73c9f87db could not be found. Jun 02 14:03:07.692132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:03:07.693579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-74f1074a-b56e-47f4-8311-bd759d2f2192 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Returning 404 to user: Instance 783eae57-62e0-4101-ae12-14b73c9f87db could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:03:07.693579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-74f1074a-b56e-47f4-8311-bd759d2f2192 tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db" status: 404 len: 111 microversion: 2.1 time: 0.029755 Jun 02 14:03:07.693579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 465/904] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:03:07 2022] GET /compute/v2.1/servers/783eae57-62e0-4101-ae12-14b73c9f87db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:03:07.699207 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-195d6b85-f411-49e1-b3f3-7cc01f12dbdc tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] Calling method '.version_select at 0x7fb71aeb4940>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:03:07.779275 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-195d6b85-f411-49e1-b3f3-7cc01f12dbdc tempest-TestMinimumBasicScenario-553733359 tempest-TestMinimumBasicScenario-553733359-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1757607995" status: 202 len: 0 microversion: 2.1 time: 0.084064 Jun 02 14:03:07.779768 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 440/905] 10.222.0.33 () {58 vars in 1271 bytes} [Thu Jun 2 14:03:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1757607995 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:03:56.107477 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e6a11bf5-dadf-4ff0-8e36-c7008420651d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:03:56.108075 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e6a11bf5-dadf-4ff0-8e36-c7008420651d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:03:56.110292 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:56.110931 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:56.115678 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6a11bf5-dadf-4ff0-8e36-c7008420651d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:56.116116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6a11bf5-dadf-4ff0-8e36-c7008420651d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:56.116895 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6a11bf5-dadf-4ff0-8e36-c7008420651d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:56.117322 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6a11bf5-dadf-4ff0-8e36-c7008420651d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:56.142166 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e6a11bf5-dadf-4ff0-8e36-c7008420651d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74/ips" status: 200 len: 152 microversion: 2.20 time: 0.039119 Jun 02 14:03:56.142871 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 466/906] 10.222.0.33 () {60 vars in 1288 bytes} [Thu Jun 2 14:03:56 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 14:03:59.301856 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d21867d8-bcbe-4de3-96a1-656ac9c15f3c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:03:59.302462 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d21867d8-bcbe-4de3-96a1-656ac9c15f3c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:03:59.304803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=56 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:59.305434 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:59.311059 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d21867d8-bcbe-4de3-96a1-656ac9c15f3c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:59.315648 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d21867d8-bcbe-4de3-96a1-656ac9c15f3c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:59.315648 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d21867d8-bcbe-4de3-96a1-656ac9c15f3c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:03:59.315648 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d21867d8-bcbe-4de3-96a1-656ac9c15f3c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:03:59.336245 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-d21867d8-bcbe-4de3-96a1-656ac9c15f3c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lazy-loading 'flavor' on Instance uuid 96011da5-6967-44e1-af2c-2ad76c52da74 {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:04:00.110315 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d21867d8-bcbe-4de3-96a1-656ac9c15f3c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "POST /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74/action" status: 202 len: 0 microversion: 2.20 time: 0.812223 Jun 02 14:04:00.110950 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 441/907] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 2 14:03:59 2022] POST /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74/action => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:04:00.119726 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-96253e1c-33a7-438c-ae70-f8d8aba03ef8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:00.120483 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-96253e1c-33a7-438c-ae70-f8d8aba03ef8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:00.128250 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-96253e1c-33a7-438c-ae70-f8d8aba03ef8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:00.129990 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-96253e1c-33a7-438c-ae70-f8d8aba03ef8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:00.129990 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-96253e1c-33a7-438c-ae70-f8d8aba03ef8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:00.129990 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-96253e1c-33a7-438c-ae70-f8d8aba03ef8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:00.372321 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-96253e1c-33a7-438c-ae70-f8d8aba03ef8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:00.380222 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-96253e1c-33a7-438c-ae70-f8d8aba03ef8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:00.381766 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-96253e1c-33a7-438c-ae70-f8d8aba03ef8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:00.382927 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-96253e1c-33a7-438c-ae70-f8d8aba03ef8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.267759 Jun 02 14:04:00.383490 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 467/908] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:00 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:01.403164 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-eff5310b-ab9a-4e2a-a69c-eb5bbc831e08 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:01.404371 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-eff5310b-ab9a-4e2a-a69c-eb5bbc831e08 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:01.410684 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-eff5310b-ab9a-4e2a-a69c-eb5bbc831e08 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:01.411136 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-eff5310b-ab9a-4e2a-a69c-eb5bbc831e08 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:01.411900 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-eff5310b-ab9a-4e2a-a69c-eb5bbc831e08 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:01.412336 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-eff5310b-ab9a-4e2a-a69c-eb5bbc831e08 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:01.540533 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-eff5310b-ab9a-4e2a-a69c-eb5bbc831e08 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:01.549160 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-eff5310b-ab9a-4e2a-a69c-eb5bbc831e08 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:01.550692 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-eff5310b-ab9a-4e2a-a69c-eb5bbc831e08 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:01.551863 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-eff5310b-ab9a-4e2a-a69c-eb5bbc831e08 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.153655 Jun 02 14:04:01.552474 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 442/909] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:01 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:02.491947 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-140dd2c4-288e-4227-ade6-40fc9a9c2416 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:02.492541 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-140dd2c4-288e-4227-ade6-40fc9a9c2416 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:02.499518 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-b553d112-9fce-41a6-b348-be606296158a req-4f6b8f50-f158-4188-9af7-bc0994dc2369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4253a95d-5443-4a20-9a10-621c058e8674", "tag": "7e76fdd4-e430-47ed-aee9-504128683d44"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:04:02.503220 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-140dd2c4-288e-4227-ade6-40fc9a9c2416 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:02.503764 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-140dd2c4-288e-4227-ade6-40fc9a9c2416 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:02.504843 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-140dd2c4-288e-4227-ade6-40fc9a9c2416 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:02.505282 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-140dd2c4-288e-4227-ade6-40fc9a9c2416 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:02.508620 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-b553d112-9fce-41a6-b348-be606296158a req-4f6b8f50-f158-4188-9af7-bc0994dc2369 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:02.509070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-b553d112-9fce-41a6-b348-be606296158a req-4f6b8f50-f158-4188-9af7-bc0994dc2369 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:02.520827 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-b553d112-9fce-41a6-b348-be606296158a req-4f6b8f50-f158-4188-9af7-bc0994dc2369 service nova] Creating event network-changed:7e76fdd4-e430-47ed-aee9-504128683d44 for instance 4253a95d-5443-4a20-9a10-621c058e8674 on hv-cinder-82651 Jun 02 14:04:02.525765 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-b553d112-9fce-41a6-b348-be606296158a req-4f6b8f50-f158-4188-9af7-bc0994dc2369 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032011 Jun 02 14:04:02.526694 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 443/910] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:04:02.532388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-140dd2c4-288e-4227-ade6-40fc9a9c2416 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Going to try to terminate instance {{(pid=118316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:04:02.745885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-db1a370e-65a4-40a3-842b-a9970fc55e44 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:02.746659 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-db1a370e-65a4-40a3-842b-a9970fc55e44 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:02.760622 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-db1a370e-65a4-40a3-842b-a9970fc55e44 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:02.762455 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-db1a370e-65a4-40a3-842b-a9970fc55e44 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:02.764858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-db1a370e-65a4-40a3-842b-a9970fc55e44 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:02.765499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-db1a370e-65a4-40a3-842b-a9970fc55e44 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:02.857971 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-140dd2c4-288e-4227-ade6-40fc9a9c2416 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 204 len: 0 microversion: 2.1 time: 0.370817 Jun 02 14:04:02.859050 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 468/911] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:04:02 2022] DELETE /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:04:02.868264 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-333a7900-7931-4cdb-834d-c3257700c251 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:02.869339 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-333a7900-7931-4cdb-834d-c3257700c251 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:02.876470 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-333a7900-7931-4cdb-834d-c3257700c251 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:02.876923 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-333a7900-7931-4cdb-834d-c3257700c251 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:02.877685 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-333a7900-7931-4cdb-834d-c3257700c251 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:02.878117 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-333a7900-7931-4cdb-834d-c3257700c251 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:02.915137 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-db1a370e-65a4-40a3-842b-a9970fc55e44 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:02.924191 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-db1a370e-65a4-40a3-842b-a9970fc55e44 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:02.925750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-db1a370e-65a4-40a3-842b-a9970fc55e44 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:02.926935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-db1a370e-65a4-40a3-842b-a9970fc55e44 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.360450 Jun 02 14:04:02.927800 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 444/912] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:02 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:04:03.019397 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-333a7900-7931-4cdb-834d-c3257700c251 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:03.027435 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-333a7900-7931-4cdb-834d-c3257700c251 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.164041 Jun 02 14:04:03.028018 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 469/913] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:02 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:04:03.945751 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-af1f9b60-6061-45a2-87c5-24a862034539 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:03.946616 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-af1f9b60-6061-45a2-87c5-24a862034539 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:03.954007 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-af1f9b60-6061-45a2-87c5-24a862034539 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:03.954447 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-af1f9b60-6061-45a2-87c5-24a862034539 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:03.955218 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-af1f9b60-6061-45a2-87c5-24a862034539 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:03.955646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-af1f9b60-6061-45a2-87c5-24a862034539 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:04.045601 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9d8fabbb-dddb-4805-a929-d416a2cf2c7d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:04.046110 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9d8fabbb-dddb-4805-a929-d416a2cf2c7d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:04.052245 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d8fabbb-dddb-4805-a929-d416a2cf2c7d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:04.052740 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d8fabbb-dddb-4805-a929-d416a2cf2c7d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:04.053512 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d8fabbb-dddb-4805-a929-d416a2cf2c7d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:04.053954 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9d8fabbb-dddb-4805-a929-d416a2cf2c7d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:04.084515 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-af1f9b60-6061-45a2-87c5-24a862034539 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:04.093834 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-af1f9b60-6061-45a2-87c5-24a862034539 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:04.095347 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-af1f9b60-6061-45a2-87c5-24a862034539 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:04.096575 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-af1f9b60-6061-45a2-87c5-24a862034539 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.154807 Jun 02 14:04:04.097466 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 445/914] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:03 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:04.187282 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9d8fabbb-dddb-4805-a929-d416a2cf2c7d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:04.195719 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9d8fabbb-dddb-4805-a929-d416a2cf2c7d tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1570 microversion: 2.1 time: 0.154057 Jun 02 14:04:04.197290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 470/915] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:04 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:04:05.115264 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1e8edcfe-9f97-41a4-a5c8-7e3a97bceef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:05.115809 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1e8edcfe-9f97-41a4-a5c8-7e3a97bceef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:05.122968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e8edcfe-9f97-41a4-a5c8-7e3a97bceef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:05.123420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e8edcfe-9f97-41a4-a5c8-7e3a97bceef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:05.124190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e8edcfe-9f97-41a4-a5c8-7e3a97bceef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:05.124655 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e8edcfe-9f97-41a4-a5c8-7e3a97bceef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:05.214534 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-23484390-6eb2-4905-b2a3-f50b5e9b9d19 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:05.215216 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-23484390-6eb2-4905-b2a3-f50b5e9b9d19 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:05.222451 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-23484390-6eb2-4905-b2a3-f50b5e9b9d19 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:05.222897 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-23484390-6eb2-4905-b2a3-f50b5e9b9d19 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:05.223845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-23484390-6eb2-4905-b2a3-f50b5e9b9d19 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:05.224534 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-23484390-6eb2-4905-b2a3-f50b5e9b9d19 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:05.260110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1e8edcfe-9f97-41a4-a5c8-7e3a97bceef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:05.269124 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1e8edcfe-9f97-41a4-a5c8-7e3a97bceef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:05.270524 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1e8edcfe-9f97-41a4-a5c8-7e3a97bceef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:05.271886 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1e8edcfe-9f97-41a4-a5c8-7e3a97bceef4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.160631 Jun 02 14:04:05.272742 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 446/916] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:05 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:05.362088 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-23484390-6eb2-4905-b2a3-f50b5e9b9d19 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:05.369780 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-23484390-6eb2-4905-b2a3-f50b5e9b9d19 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1451 microversion: 2.1 time: 0.159343 Jun 02 14:04:05.370292 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 471/917] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:05 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:04:05.451016 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-59e13604-d392-4de8-8557-30d605b58255 req-cd18539a-b3f1-413c-a20d-80f165982920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4253a95d-5443-4a20-9a10-621c058e8674", "name": "network-vif-deleted", "tag": "7e76fdd4-e430-47ed-aee9-504128683d44"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:04:05.459177 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-59e13604-d392-4de8-8557-30d605b58255 req-cd18539a-b3f1-413c-a20d-80f165982920 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:05.463859 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-59e13604-d392-4de8-8557-30d605b58255 req-cd18539a-b3f1-413c-a20d-80f165982920 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:05.471196 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-59e13604-d392-4de8-8557-30d605b58255 req-cd18539a-b3f1-413c-a20d-80f165982920 service nova] Creating event network-vif-deleted:7e76fdd4-e430-47ed-aee9-504128683d44 for instance 4253a95d-5443-4a20-9a10-621c058e8674 on hv-cinder-82651 Jun 02 14:04:05.476132 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-59e13604-d392-4de8-8557-30d605b58255 req-cd18539a-b3f1-413c-a20d-80f165982920 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029590 Jun 02 14:04:05.476884 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 447/918] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:04:06.290651 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6ad80df1-303d-49a1-9241-f22c34e79841 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:06.291266 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6ad80df1-303d-49a1-9241-f22c34e79841 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:06.298711 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6ad80df1-303d-49a1-9241-f22c34e79841 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:06.299159 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6ad80df1-303d-49a1-9241-f22c34e79841 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:06.299919 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6ad80df1-303d-49a1-9241-f22c34e79841 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:06.300617 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6ad80df1-303d-49a1-9241-f22c34e79841 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:06.387276 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-8bec1ce7-df99-428a-b3d4-b47e9c63aedf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:06.388107 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-8bec1ce7-df99-428a-b3d4-b47e9c63aedf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:06.394813 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8bec1ce7-df99-428a-b3d4-b47e9c63aedf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:06.395259 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8bec1ce7-df99-428a-b3d4-b47e9c63aedf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:06.396022 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8bec1ce7-df99-428a-b3d4-b47e9c63aedf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:06.396469 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8bec1ce7-df99-428a-b3d4-b47e9c63aedf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:06.428566 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8bec1ce7-df99-428a-b3d4-b47e9c63aedf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:06.429025 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8bec1ce7-df99-428a-b3d4-b47e9c63aedf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:06.429476 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-8bec1ce7-df99-428a-b3d4-b47e9c63aedf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lazy-loading 'fault' on Instance uuid 4253a95d-5443-4a20-9a10-621c058e8674 {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:04:06.439836 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6ad80df1-303d-49a1-9241-f22c34e79841 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:06.448341 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6ad80df1-303d-49a1-9241-f22c34e79841 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:06.449950 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6ad80df1-303d-49a1-9241-f22c34e79841 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:06.451191 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6ad80df1-303d-49a1-9241-f22c34e79841 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.164444 Jun 02 14:04:06.451756 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 472/919] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:06 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:06.472916 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-8bec1ce7-df99-428a-b3d4-b47e9c63aedf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198160f6a7524bbb9f90798d2269db00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:06.480601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-8bec1ce7-df99-428a-b3d4-b47e9c63aedf tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 200 len: 1225 microversion: 2.1 time: 0.097585 Jun 02 14:04:06.481277 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 448/920] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:06 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:04:07.469642 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a1535248-c8d3-4df0-a735-251c24211fbc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:07.470255 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a1535248-c8d3-4df0-a735-251c24211fbc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:07.476779 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a1535248-c8d3-4df0-a735-251c24211fbc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:07.477230 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a1535248-c8d3-4df0-a735-251c24211fbc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:07.477986 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a1535248-c8d3-4df0-a735-251c24211fbc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:07.478417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a1535248-c8d3-4df0-a735-251c24211fbc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:07.503867 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-87c300e3-d7fe-4d3e-9fb3-cf8367079c93 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:07.504520 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-87c300e3-d7fe-4d3e-9fb3-cf8367079c93 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] [instance: 4253a95d-5443-4a20-9a10-621c058e8674] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:07.511112 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-87c300e3-d7fe-4d3e-9fb3-cf8367079c93 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:07.511561 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-87c300e3-d7fe-4d3e-9fb3-cf8367079c93 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:07.512328 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-87c300e3-d7fe-4d3e-9fb3-cf8367079c93 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:07.513484 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-87c300e3-d7fe-4d3e-9fb3-cf8367079c93 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:07.527349 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-87c300e3-d7fe-4d3e-9fb3-cf8367079c93 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] HTTP exception thrown: Instance 4253a95d-5443-4a20-9a10-621c058e8674 could not be found. Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-87c300e3-d7fe-4d3e-9fb3-cf8367079c93 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Request method failure captured: Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 HTTP/1.1 Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMF6qu3Yz6JPLPRTA4F6qJsy0UTBzX3P-pZ0M82zOFlXnDJPsb9eNxKEPazlKm_h1se93yQ4Ooq3tBs8RxAPZHClsuNIK8KAF25RRgVUW6lRzujY53T7-L8WEhUl61bWqHu-93OUaLXysl0hW5CDialpj3Q8Jr3zfGcYILBTKa5B5wo Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: c5c02b70c6fa4d4b999cca3d9f6154c5 Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-TestShelveInstance-135913445 Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:04:07.529439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:04:07.531175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c5c02b70c6fa4d4b999cca3d9f6154c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5c02b70c6fa4d4b999cca3d9f6154c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5c02b70c6fa4d4b999cca3d9f6154c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c5c02b70c6fa4d4b999cca3d9f6154c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:04:07.531175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-TestShelveInstance-135913445 Jun 02 14:04:07.531175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: c5c02b70c6fa4d4b999cca3d9f6154c5 Jun 02 14:04:07.531175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-TestShelveInstance-135913445 Jun 02 14:04:07.531175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-TestShelveInstance-135913445-project Jun 02 14:04:07.531175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:04:07.531175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:04:07.531175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 198160f6a7524bbb9f90798d2269db00 Jun 02 14:04:07.531175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-TestShelveInstance-135913445-project Jun 02 14:04:07.531175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:04:07.531175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance 4253a95d-5443-4a20-9a10-621c058e8674 could not be found. Jun 02 14:04:07.531175 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '4253a95d-5443-4a20-9a10-621c058e8674'} Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4253a95d-5443-4a20-9a10-621c058e8674 could not be found. Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:04:07.532063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4253a95d-5443-4a20-9a10-621c058e8674 could not be found. Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4253a95d-5443-4a20-9a10-621c058e8674 could not be found. Jun 02 14:04:07.533418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:04:07.534587 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-87c300e3-d7fe-4d3e-9fb3-cf8367079c93 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Returning 404 to user: Instance 4253a95d-5443-4a20-9a10-621c058e8674 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:04:07.534587 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-87c300e3-d7fe-4d3e-9fb3-cf8367079c93 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674" status: 404 len: 111 microversion: 2.1 time: 0.035423 Jun 02 14:04:07.534587 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 449/921] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:07 2022] GET /compute/v2.1/servers/4253a95d-5443-4a20-9a10-621c058e8674 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 14:04:07.617535 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a1535248-c8d3-4df0-a735-251c24211fbc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:07.629777 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a1535248-c8d3-4df0-a735-251c24211fbc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:07.629777 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a1535248-c8d3-4df0-a735-251c24211fbc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:07.629777 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a1535248-c8d3-4df0-a735-251c24211fbc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.164051 Jun 02 14:04:07.630392 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 473/922] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:07 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:07.775516 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3e6d59a2-d33a-4780-be68-20cbb48130f1 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] Calling method '.version_select at 0x7fb71adba3a0>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:07.875630 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3e6d59a2-d33a-4780-be68-20cbb48130f1 tempest-TestShelveInstance-135913445 tempest-TestShelveInstance-135913445-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1654500253" status: 202 len: 0 microversion: 2.1 time: 0.103940 Jun 02 14:04:07.876204 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 450/923] 10.222.0.33 () {58 vars in 1253 bytes} [Thu Jun 2 14:04:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1654500253 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:04:08.652317 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4bb48f42-a7ee-47c9-9fcc-3d637260715b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:08.652976 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4bb48f42-a7ee-47c9-9fcc-3d637260715b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:08.659373 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4bb48f42-a7ee-47c9-9fcc-3d637260715b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:08.659812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4bb48f42-a7ee-47c9-9fcc-3d637260715b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:08.660625 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4bb48f42-a7ee-47c9-9fcc-3d637260715b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:08.661051 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4bb48f42-a7ee-47c9-9fcc-3d637260715b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:08.792028 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4bb48f42-a7ee-47c9-9fcc-3d637260715b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:08.801076 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4bb48f42-a7ee-47c9-9fcc-3d637260715b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:08.802733 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4bb48f42-a7ee-47c9-9fcc-3d637260715b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:08.803989 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4bb48f42-a7ee-47c9-9fcc-3d637260715b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.156465 Jun 02 14:04:08.804645 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 474/924] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:08 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:09.823310 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e696250e-5797-41d2-9aa5-73affa9865e6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:09.823916 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e696250e-5797-41d2-9aa5-73affa9865e6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:09.832056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e696250e-5797-41d2-9aa5-73affa9865e6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:09.832617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e696250e-5797-41d2-9aa5-73affa9865e6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:09.833453 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e696250e-5797-41d2-9aa5-73affa9865e6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:09.833952 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e696250e-5797-41d2-9aa5-73affa9865e6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:09.974898 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e696250e-5797-41d2-9aa5-73affa9865e6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:09.983710 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e696250e-5797-41d2-9aa5-73affa9865e6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:09.985299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e696250e-5797-41d2-9aa5-73affa9865e6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:09.986487 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e696250e-5797-41d2-9aa5-73affa9865e6 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.168113 Jun 02 14:04:09.987043 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 451/925] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:09 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:11.006017 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a9e54ff6-11d7-4768-8503-cbff70519872 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:11.006801 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a9e54ff6-11d7-4768-8503-cbff70519872 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:11.016643 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a9e54ff6-11d7-4768-8503-cbff70519872 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:11.017312 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a9e54ff6-11d7-4768-8503-cbff70519872 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:11.018094 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a9e54ff6-11d7-4768-8503-cbff70519872 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:11.018768 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a9e54ff6-11d7-4768-8503-cbff70519872 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:11.263775 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a9e54ff6-11d7-4768-8503-cbff70519872 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:11.272555 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a9e54ff6-11d7-4768-8503-cbff70519872 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:11.274084 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a9e54ff6-11d7-4768-8503-cbff70519872 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:11.275384 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a9e54ff6-11d7-4768-8503-cbff70519872 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.273291 Jun 02 14:04:11.275955 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 475/926] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:11 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:12.293465 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d1595d18-7855-4d6f-b26b-63cf056a2463 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:12.295490 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d1595d18-7855-4d6f-b26b-63cf056a2463 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:12.303976 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d1595d18-7855-4d6f-b26b-63cf056a2463 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:12.304531 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d1595d18-7855-4d6f-b26b-63cf056a2463 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:12.305366 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d1595d18-7855-4d6f-b26b-63cf056a2463 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:12.305903 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d1595d18-7855-4d6f-b26b-63cf056a2463 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:12.438956 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d1595d18-7855-4d6f-b26b-63cf056a2463 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:12.447227 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d1595d18-7855-4d6f-b26b-63cf056a2463 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:12.448865 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d1595d18-7855-4d6f-b26b-63cf056a2463 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:12.449942 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d1595d18-7855-4d6f-b26b-63cf056a2463 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.160456 Jun 02 14:04:12.451183 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 452/927] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:12 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:13.470008 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-12a4bd0d-2fda-44c1-ba03-cbb0b6587550 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:13.471329 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-12a4bd0d-2fda-44c1-ba03-cbb0b6587550 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:13.478618 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-12a4bd0d-2fda-44c1-ba03-cbb0b6587550 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:13.479204 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-12a4bd0d-2fda-44c1-ba03-cbb0b6587550 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:13.480047 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-12a4bd0d-2fda-44c1-ba03-cbb0b6587550 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:13.480603 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-12a4bd0d-2fda-44c1-ba03-cbb0b6587550 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:13.631121 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-12a4bd0d-2fda-44c1-ba03-cbb0b6587550 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:13.641050 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-12a4bd0d-2fda-44c1-ba03-cbb0b6587550 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:13.643040 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-12a4bd0d-2fda-44c1-ba03-cbb0b6587550 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:13.644501 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-12a4bd0d-2fda-44c1-ba03-cbb0b6587550 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.179307 Jun 02 14:04:13.645069 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 476/928] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:13 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:04:14.663882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-61a7a6ec-35f7-40e0-bb0d-8318a3174ff2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:14.664957 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-61a7a6ec-35f7-40e0-bb0d-8318a3174ff2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:14.680517 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-61a7a6ec-35f7-40e0-bb0d-8318a3174ff2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:14.680907 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-61a7a6ec-35f7-40e0-bb0d-8318a3174ff2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:14.681700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-61a7a6ec-35f7-40e0-bb0d-8318a3174ff2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:14.682135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-61a7a6ec-35f7-40e0-bb0d-8318a3174ff2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:14.935899 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-61a7a6ec-35f7-40e0-bb0d-8318a3174ff2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:14.945491 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-61a7a6ec-35f7-40e0-bb0d-8318a3174ff2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:14.948517 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-61a7a6ec-35f7-40e0-bb0d-8318a3174ff2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:14.949706 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-61a7a6ec-35f7-40e0-bb0d-8318a3174ff2 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.290205 Jun 02 14:04:14.950382 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 453/929] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:14 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:15.968221 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-cc687bf6-0f3b-4515-8fae-e5be4a9fe98c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:15.968849 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-cc687bf6-0f3b-4515-8fae-e5be4a9fe98c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:15.975296 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cc687bf6-0f3b-4515-8fae-e5be4a9fe98c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:15.975736 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cc687bf6-0f3b-4515-8fae-e5be4a9fe98c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:15.976524 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cc687bf6-0f3b-4515-8fae-e5be4a9fe98c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:15.976936 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cc687bf6-0f3b-4515-8fae-e5be4a9fe98c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:16.135690 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-cc687bf6-0f3b-4515-8fae-e5be4a9fe98c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:16.143832 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-cc687bf6-0f3b-4515-8fae-e5be4a9fe98c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:16.145566 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-cc687bf6-0f3b-4515-8fae-e5be4a9fe98c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:16.146728 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-cc687bf6-0f3b-4515-8fae-e5be4a9fe98c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.182705 Jun 02 14:04:16.147679 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 477/930] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:15 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:17.165004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-396ef666-221b-4b55-b06b-df2b4a841f0d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:17.165608 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-396ef666-221b-4b55-b06b-df2b4a841f0d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:17.172176 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-396ef666-221b-4b55-b06b-df2b4a841f0d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:17.172649 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-396ef666-221b-4b55-b06b-df2b4a841f0d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:17.173398 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-396ef666-221b-4b55-b06b-df2b4a841f0d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:17.173822 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-396ef666-221b-4b55-b06b-df2b4a841f0d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:17.318586 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-396ef666-221b-4b55-b06b-df2b4a841f0d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:17.327614 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-396ef666-221b-4b55-b06b-df2b4a841f0d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:17.329217 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-396ef666-221b-4b55-b06b-df2b4a841f0d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:17.330441 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-396ef666-221b-4b55-b06b-df2b4a841f0d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.169310 Jun 02 14:04:17.330992 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 454/931] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:17 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:18.348979 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-187a58b1-39b3-49bc-9234-d26ee042ce21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:18.349579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-187a58b1-39b3-49bc-9234-d26ee042ce21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:18.356374 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-187a58b1-39b3-49bc-9234-d26ee042ce21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:18.356878 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-187a58b1-39b3-49bc-9234-d26ee042ce21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:18.357812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-187a58b1-39b3-49bc-9234-d26ee042ce21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:18.358241 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-187a58b1-39b3-49bc-9234-d26ee042ce21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:18.487362 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-187a58b1-39b3-49bc-9234-d26ee042ce21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:18.495372 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-187a58b1-39b3-49bc-9234-d26ee042ce21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:18.496925 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-187a58b1-39b3-49bc-9234-d26ee042ce21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:18.498619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-187a58b1-39b3-49bc-9234-d26ee042ce21 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1745 microversion: 2.20 time: 0.153580 Jun 02 14:04:18.499388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 478/932] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:18 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:19.517868 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a3d21a2b-095d-44e4-8f60-247f77c0788a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:19.518480 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a3d21a2b-095d-44e4-8f60-247f77c0788a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:19.525163 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a3d21a2b-095d-44e4-8f60-247f77c0788a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:19.525614 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a3d21a2b-095d-44e4-8f60-247f77c0788a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:19.526377 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a3d21a2b-095d-44e4-8f60-247f77c0788a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:19.526808 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a3d21a2b-095d-44e4-8f60-247f77c0788a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:19.658110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a3d21a2b-095d-44e4-8f60-247f77c0788a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:19.666095 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a3d21a2b-095d-44e4-8f60-247f77c0788a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:19.667615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a3d21a2b-095d-44e4-8f60-247f77c0788a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:19.668804 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a3d21a2b-095d-44e4-8f60-247f77c0788a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1745 microversion: 2.20 time: 0.155526 Jun 02 14:04:19.669357 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 455/933] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:19 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:20.687609 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ca1240c0-c8b5-4793-8d32-49d8104cc438 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:20.688451 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ca1240c0-c8b5-4793-8d32-49d8104cc438 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:20.694975 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ca1240c0-c8b5-4793-8d32-49d8104cc438 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:20.695358 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ca1240c0-c8b5-4793-8d32-49d8104cc438 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:20.696395 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ca1240c0-c8b5-4793-8d32-49d8104cc438 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:20.696853 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ca1240c0-c8b5-4793-8d32-49d8104cc438 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:20.837160 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ca1240c0-c8b5-4793-8d32-49d8104cc438 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:20.845867 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ca1240c0-c8b5-4793-8d32-49d8104cc438 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:20.847381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ca1240c0-c8b5-4793-8d32-49d8104cc438 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:20.848594 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ca1240c0-c8b5-4793-8d32-49d8104cc438 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1745 microversion: 2.20 time: 0.165504 Jun 02 14:04:20.849161 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 479/934] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:20 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:21.867214 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c58f357e-1ddb-4961-973a-244a31fe2756 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:21.867753 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c58f357e-1ddb-4961-973a-244a31fe2756 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:21.874259 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c58f357e-1ddb-4961-973a-244a31fe2756 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:21.874696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c58f357e-1ddb-4961-973a-244a31fe2756 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:21.875441 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c58f357e-1ddb-4961-973a-244a31fe2756 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:21.875868 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c58f357e-1ddb-4961-973a-244a31fe2756 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:22.015505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c58f357e-1ddb-4961-973a-244a31fe2756 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:22.023555 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c58f357e-1ddb-4961-973a-244a31fe2756 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:22.025669 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c58f357e-1ddb-4961-973a-244a31fe2756 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:22.026834 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c58f357e-1ddb-4961-973a-244a31fe2756 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1745 microversion: 2.20 time: 0.163647 Jun 02 14:04:22.027406 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 456/935] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:21 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:22.597891 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-d73e1632-65e6-4cad-aa7a-47d66b6f11d1 req-4045fcdb-caba-40ce-8a61-d2ca104c5763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96011da5-6967-44e1-af2c-2ad76c52da74", "name": "network-vif-plugged", "status": "completed", "tag": "ef61b669-91ec-4f6a-b126-1de24442c7c0"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:04:22.606507 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-d73e1632-65e6-4cad-aa7a-47d66b6f11d1 req-4045fcdb-caba-40ce-8a61-d2ca104c5763 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:22.606964 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-d73e1632-65e6-4cad-aa7a-47d66b6f11d1 req-4045fcdb-caba-40ce-8a61-d2ca104c5763 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:22.618407 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-d73e1632-65e6-4cad-aa7a-47d66b6f11d1 req-4045fcdb-caba-40ce-8a61-d2ca104c5763 service nova] Creating event network-vif-plugged:ef61b669-91ec-4f6a-b126-1de24442c7c0 for instance 96011da5-6967-44e1-af2c-2ad76c52da74 on hv-cinder-82651 Jun 02 14:04:22.624161 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-d73e1632-65e6-4cad-aa7a-47d66b6f11d1 req-4045fcdb-caba-40ce-8a61-d2ca104c5763 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029518 Jun 02 14:04:22.624937 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 480/936] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:04:23.046817 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-132c288f-e5c7-4d2a-b374-aafa8450982c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:23.047425 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-132c288f-e5c7-4d2a-b374-aafa8450982c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:23.053828 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-132c288f-e5c7-4d2a-b374-aafa8450982c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:23.054274 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-132c288f-e5c7-4d2a-b374-aafa8450982c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:23.055022 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-132c288f-e5c7-4d2a-b374-aafa8450982c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:23.055732 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-132c288f-e5c7-4d2a-b374-aafa8450982c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:23.186044 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-132c288f-e5c7-4d2a-b374-aafa8450982c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:23.194174 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-132c288f-e5c7-4d2a-b374-aafa8450982c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:23.199957 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-132c288f-e5c7-4d2a-b374-aafa8450982c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:23.199957 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-132c288f-e5c7-4d2a-b374-aafa8450982c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1745 microversion: 2.20 time: 0.154994 Jun 02 14:04:23.199957 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 457/937] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:23 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:24.216829 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-dc1bda04-1f80-4112-bd23-273f2c5416bc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:24.217644 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-dc1bda04-1f80-4112-bd23-273f2c5416bc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:24.224068 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dc1bda04-1f80-4112-bd23-273f2c5416bc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:24.224548 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dc1bda04-1f80-4112-bd23-273f2c5416bc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:24.225303 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dc1bda04-1f80-4112-bd23-273f2c5416bc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:24.225777 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-dc1bda04-1f80-4112-bd23-273f2c5416bc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:24.365883 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-dc1bda04-1f80-4112-bd23-273f2c5416bc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:24.369453 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:24.374944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-dc1bda04-1f80-4112-bd23-273f2c5416bc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:24.376488 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-dc1bda04-1f80-4112-bd23-273f2c5416bc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:24.377653 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-dc1bda04-1f80-4112-bd23-273f2c5416bc tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1745 microversion: 2.20 time: 0.165718 Jun 02 14:04:24.378214 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 481/938] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:24 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:25.396215 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1ae46045-3367-464e-9418-5d28024d9518 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:25.396842 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1ae46045-3367-464e-9418-5d28024d9518 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:25.403266 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1ae46045-3367-464e-9418-5d28024d9518 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:25.403711 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1ae46045-3367-464e-9418-5d28024d9518 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:25.404502 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1ae46045-3367-464e-9418-5d28024d9518 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:25.404977 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1ae46045-3367-464e-9418-5d28024d9518 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:25.408981 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:25.532617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1ae46045-3367-464e-9418-5d28024d9518 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:25.540657 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1ae46045-3367-464e-9418-5d28024d9518 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:25.542189 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1ae46045-3367-464e-9418-5d28024d9518 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:25.543365 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1ae46045-3367-464e-9418-5d28024d9518 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1745 microversion: 2.20 time: 0.151103 Jun 02 14:04:25.543911 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 458/939] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:25 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:26.562125 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-76aa2ff4-4af2-4b47-ae5b-0bde03b7669a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:26.562769 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-76aa2ff4-4af2-4b47-ae5b-0bde03b7669a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:26.569638 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-76aa2ff4-4af2-4b47-ae5b-0bde03b7669a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:26.570085 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-76aa2ff4-4af2-4b47-ae5b-0bde03b7669a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:26.571100 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-76aa2ff4-4af2-4b47-ae5b-0bde03b7669a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:26.571532 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-76aa2ff4-4af2-4b47-ae5b-0bde03b7669a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:26.703404 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-76aa2ff4-4af2-4b47-ae5b-0bde03b7669a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:26.711567 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-76aa2ff4-4af2-4b47-ae5b-0bde03b7669a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:26.713169 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-76aa2ff4-4af2-4b47-ae5b-0bde03b7669a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:26.714346 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-76aa2ff4-4af2-4b47-ae5b-0bde03b7669a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1745 microversion: 2.20 time: 0.156586 Jun 02 14:04:26.714909 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 482/940] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:26 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:27.733118 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-270d7903-7c92-4738-bb85-7b0dea2a0b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:27.734308 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-270d7903-7c92-4738-bb85-7b0dea2a0b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:27.740881 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-270d7903-7c92-4738-bb85-7b0dea2a0b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:27.741329 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-270d7903-7c92-4738-bb85-7b0dea2a0b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:27.742094 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-270d7903-7c92-4738-bb85-7b0dea2a0b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:27.742530 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-270d7903-7c92-4738-bb85-7b0dea2a0b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:27.870498 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-270d7903-7c92-4738-bb85-7b0dea2a0b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:27.878613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-270d7903-7c92-4738-bb85-7b0dea2a0b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:27.880152 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-270d7903-7c92-4738-bb85-7b0dea2a0b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:27.881348 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-270d7903-7c92-4738-bb85-7b0dea2a0b8e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1745 microversion: 2.20 time: 0.152106 Jun 02 14:04:27.881987 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 459/941] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:27 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:04:28.904162 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b293f3ce-3c32-482f-8feb-2721b925d381 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:28.904162 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b293f3ce-3c32-482f-8feb-2721b925d381 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:28.910903 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b293f3ce-3c32-482f-8feb-2721b925d381 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:28.911347 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b293f3ce-3c32-482f-8feb-2721b925d381 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:28.912103 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b293f3ce-3c32-482f-8feb-2721b925d381 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:28.912555 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b293f3ce-3c32-482f-8feb-2721b925d381 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:29.049244 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b293f3ce-3c32-482f-8feb-2721b925d381 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:29.057394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b293f3ce-3c32-482f-8feb-2721b925d381 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:29.058945 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b293f3ce-3c32-482f-8feb-2721b925d381 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:29.060115 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b293f3ce-3c32-482f-8feb-2721b925d381 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.161460 Jun 02 14:04:29.060709 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 483/942] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:28 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:30.078414 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b19d684f-0abf-4e3e-984f-84ed22f41dcf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:30.079765 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b19d684f-0abf-4e3e-984f-84ed22f41dcf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:30.081877 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:30.087334 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b19d684f-0abf-4e3e-984f-84ed22f41dcf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:30.087772 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b19d684f-0abf-4e3e-984f-84ed22f41dcf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:30.088559 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b19d684f-0abf-4e3e-984f-84ed22f41dcf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:30.089026 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b19d684f-0abf-4e3e-984f-84ed22f41dcf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:30.232642 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b19d684f-0abf-4e3e-984f-84ed22f41dcf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:30.241943 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b19d684f-0abf-4e3e-984f-84ed22f41dcf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:30.243702 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b19d684f-0abf-4e3e-984f-84ed22f41dcf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:30.244929 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b19d684f-0abf-4e3e-984f-84ed22f41dcf tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.170723 Jun 02 14:04:30.245479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 460/943] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:30 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:31.263668 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f11b02aa-c139-436c-b884-6449bbb54945 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:31.264312 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f11b02aa-c139-436c-b884-6449bbb54945 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:31.271205 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:31.272936 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f11b02aa-c139-436c-b884-6449bbb54945 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:31.273385 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f11b02aa-c139-436c-b884-6449bbb54945 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:31.274438 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f11b02aa-c139-436c-b884-6449bbb54945 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:31.275124 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f11b02aa-c139-436c-b884-6449bbb54945 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:31.420942 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f11b02aa-c139-436c-b884-6449bbb54945 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:31.429921 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f11b02aa-c139-436c-b884-6449bbb54945 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:31.431426 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f11b02aa-c139-436c-b884-6449bbb54945 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:31.432617 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f11b02aa-c139-436c-b884-6449bbb54945 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.172873 Jun 02 14:04:31.433538 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 484/944] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:31 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:04:32.451379 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fd3e701e-1310-4749-98e4-a5e5df5f5987 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:32.452147 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-fd3e701e-1310-4749-98e4-a5e5df5f5987 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:32.459781 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fd3e701e-1310-4749-98e4-a5e5df5f5987 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:32.460225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fd3e701e-1310-4749-98e4-a5e5df5f5987 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:32.461028 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fd3e701e-1310-4749-98e4-a5e5df5f5987 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:32.461460 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-fd3e701e-1310-4749-98e4-a5e5df5f5987 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:32.599573 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-fd3e701e-1310-4749-98e4-a5e5df5f5987 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:32.608121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-fd3e701e-1310-4749-98e4-a5e5df5f5987 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:32.609672 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-fd3e701e-1310-4749-98e4-a5e5df5f5987 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:32.610900 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-fd3e701e-1310-4749-98e4-a5e5df5f5987 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.163494 Jun 02 14:04:32.612128 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 461/945] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:32 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:33.630542 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b6a07a31-8557-463a-b506-7aef5d48d43e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:33.631154 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b6a07a31-8557-463a-b506-7aef5d48d43e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:33.637624 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b6a07a31-8557-463a-b506-7aef5d48d43e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:33.638066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b6a07a31-8557-463a-b506-7aef5d48d43e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:33.638816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b6a07a31-8557-463a-b506-7aef5d48d43e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:33.639243 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b6a07a31-8557-463a-b506-7aef5d48d43e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:33.771750 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b6a07a31-8557-463a-b506-7aef5d48d43e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:33.780395 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b6a07a31-8557-463a-b506-7aef5d48d43e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:33.781926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b6a07a31-8557-463a-b506-7aef5d48d43e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:33.783143 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b6a07a31-8557-463a-b506-7aef5d48d43e tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.156958 Jun 02 14:04:33.783860 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 485/946] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:33 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:34.801892 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1fcf3bd0-1d59-43ba-a3de-873fb0e15598 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:34.802502 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1fcf3bd0-1d59-43ba-a3de-873fb0e15598 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:34.808884 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1fcf3bd0-1d59-43ba-a3de-873fb0e15598 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:34.809325 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1fcf3bd0-1d59-43ba-a3de-873fb0e15598 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:34.810099 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1fcf3bd0-1d59-43ba-a3de-873fb0e15598 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:34.810526 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1fcf3bd0-1d59-43ba-a3de-873fb0e15598 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:34.943860 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1fcf3bd0-1d59-43ba-a3de-873fb0e15598 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:34.952268 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1fcf3bd0-1d59-43ba-a3de-873fb0e15598 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:34.956589 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1fcf3bd0-1d59-43ba-a3de-873fb0e15598 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:34.956589 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1fcf3bd0-1d59-43ba-a3de-873fb0e15598 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.157876 Jun 02 14:04:34.956811 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 462/947] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:34 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:35.974430 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-1098f745-20a1-4181-9709-c0f9485cfea8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:35.975932 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-1098f745-20a1-4181-9709-c0f9485cfea8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:35.983942 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1098f745-20a1-4181-9709-c0f9485cfea8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:35.984396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1098f745-20a1-4181-9709-c0f9485cfea8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:35.985202 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1098f745-20a1-4181-9709-c0f9485cfea8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:35.985616 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1098f745-20a1-4181-9709-c0f9485cfea8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:36.125536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1098f745-20a1-4181-9709-c0f9485cfea8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:36.133820 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1098f745-20a1-4181-9709-c0f9485cfea8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:36.135756 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1098f745-20a1-4181-9709-c0f9485cfea8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:36.136841 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-1098f745-20a1-4181-9709-c0f9485cfea8 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.167354 Jun 02 14:04:36.148347 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 486/948] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:35 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:36.339116 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-674284733", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1891088145", "security_groups": [{"name": "tempest-secgroup-smoke-995264798"}], "block_device_mapping_v2": [{"uuid": "e87afbf2-1a2b-42f8-9159-1e3a0f12c0b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "86c95916-f1de-4921-b403-dd7a25eabe5a"}]}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:04:36.459301 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.network.neutron [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] validate_networks() for [('86c95916-f1de-4921-b403-dd7a25eabe5a', None, None, None, None, None)] {{(pid=118315) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 14:04:37.081677 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Flavor limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 14:04:37.082091 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Image limits 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 14:04:37.082554 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Flavor pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 14:04:37.082951 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Image pref 0:0:0 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 14:04:37.083351 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.virt.hardware [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118315) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 14:04:37.092677 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:37.093136 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:37.093948 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:37.094383 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:37.113320 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Getting quotas for project b55a34a53b2740d9af5efd660424a456. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:04:37.117584 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Getting quotas for user 315c0d9d9a284389ae07bf898c330605 and project b55a34a53b2740d9af5efd660424a456. Resources: {'instances', 'ram', 'cores'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:04:37.155098 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d63cda21-7993-43a2-a6a1-bc6a3668f1af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:37.155724 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d63cda21-7993-43a2-a6a1-bc6a3668f1af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:37.163147 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d63cda21-7993-43a2-a6a1-bc6a3668f1af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:37.166452 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d63cda21-7993-43a2-a6a1-bc6a3668f1af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:37.166452 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d63cda21-7993-43a2-a6a1-bc6a3668f1af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:37.166452 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d63cda21-7993-43a2-a6a1-bc6a3668f1af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:37.185466 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Going to run 1 instances... {{(pid=118315) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 14:04:37.187642 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e87afbf2-1a2b-42f8-9159-1e3a0f12c0b3',volume_size=None,volume_type=None)] {{(pid=118315) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 14:04:37.331555 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d63cda21-7993-43a2-a6a1-bc6a3668f1af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:37.339800 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d63cda21-7993-43a2-a6a1-bc6a3668f1af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:37.341428 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d63cda21-7993-43a2-a6a1-bc6a3668f1af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:37.342688 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d63cda21-7993-43a2-a6a1-bc6a3668f1af tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.191645 Jun 02 14:04:37.343252 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 487/949] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:37 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:37.608277 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b8aa4005-e3c5-4ba9-9a74-bb44742bdeba tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.272981 Jun 02 14:04:37.615147 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 463/950] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 14:04:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 14:04:37.620393 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8864c588-2115-4aed-84c9-389f13e4970e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:37.621195 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8864c588-2115-4aed-84c9-389f13e4970e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:37.683152 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8864c588-2115-4aed-84c9-389f13e4970e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:37.691504 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8864c588-2115-4aed-84c9-389f13e4970e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1094 microversion: 2.1 time: 0.075207 Jun 02 14:04:37.695365 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 488/951] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:37 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:04:38.360710 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-addc1172-329d-4057-87dd-d30e4f7b14d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:38.361377 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-addc1172-329d-4057-87dd-d30e4f7b14d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:38.368382 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-addc1172-329d-4057-87dd-d30e4f7b14d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:38.368962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-addc1172-329d-4057-87dd-d30e4f7b14d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:38.369787 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-addc1172-329d-4057-87dd-d30e4f7b14d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:38.370226 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-addc1172-329d-4057-87dd-d30e4f7b14d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:38.551679 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-addc1172-329d-4057-87dd-d30e4f7b14d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:38.560634 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-addc1172-329d-4057-87dd-d30e4f7b14d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:38.562218 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-addc1172-329d-4057-87dd-d30e4f7b14d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:38.563568 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-addc1172-329d-4057-87dd-d30e4f7b14d4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.206891 Jun 02 14:04:38.564148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 464/952] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:38 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:38.709680 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0ee52d86-a9dd-4ac2-86dd-016aa4cf1c61 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:38.710433 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0ee52d86-a9dd-4ac2-86dd-016aa4cf1c61 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:38.717884 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ee52d86-a9dd-4ac2-86dd-016aa4cf1c61 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:38.718341 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ee52d86-a9dd-4ac2-86dd-016aa4cf1c61 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:38.719106 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ee52d86-a9dd-4ac2-86dd-016aa4cf1c61 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:38.719539 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0ee52d86-a9dd-4ac2-86dd-016aa4cf1c61 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:38.784751 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0ee52d86-a9dd-4ac2-86dd-016aa4cf1c61 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:38.795553 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0ee52d86-a9dd-4ac2-86dd-016aa4cf1c61 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1144 microversion: 2.1 time: 0.090438 Jun 02 14:04:38.796257 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 489/953] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:38 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:04:39.584079 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e3e15bb6-f833-4f3c-bb96-ef75f3012cd7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:39.584943 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e3e15bb6-f833-4f3c-bb96-ef75f3012cd7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:39.594262 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e3e15bb6-f833-4f3c-bb96-ef75f3012cd7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:39.599123 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e3e15bb6-f833-4f3c-bb96-ef75f3012cd7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:39.599123 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e3e15bb6-f833-4f3c-bb96-ef75f3012cd7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:39.599123 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e3e15bb6-f833-4f3c-bb96-ef75f3012cd7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:39.742113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e3e15bb6-f833-4f3c-bb96-ef75f3012cd7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:39.750241 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e3e15bb6-f833-4f3c-bb96-ef75f3012cd7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:39.751882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e3e15bb6-f833-4f3c-bb96-ef75f3012cd7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:39.753707 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e3e15bb6-f833-4f3c-bb96-ef75f3012cd7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.174516 Jun 02 14:04:39.754740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 465/954] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:39 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:39.817393 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9c8cc8f9-5e25-4b32-89ff-3153b537c401 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:39.818150 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9c8cc8f9-5e25-4b32-89ff-3153b537c401 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:39.825201 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9c8cc8f9-5e25-4b32-89ff-3153b537c401 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:39.825684 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9c8cc8f9-5e25-4b32-89ff-3153b537c401 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:39.826471 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9c8cc8f9-5e25-4b32-89ff-3153b537c401 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:39.826909 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9c8cc8f9-5e25-4b32-89ff-3153b537c401 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:39.899607 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9c8cc8f9-5e25-4b32-89ff-3153b537c401 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:39.907120 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9c8cc8f9-5e25-4b32-89ff-3153b537c401 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1192 microversion: 2.1 time: 0.094673 Jun 02 14:04:39.912920 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 490/955] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:39 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:04:40.774045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ca2e6867-5e26-4463-aad2-8a10df52fcde tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:40.775457 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ca2e6867-5e26-4463-aad2-8a10df52fcde tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:40.782993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ca2e6867-5e26-4463-aad2-8a10df52fcde tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:40.783449 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ca2e6867-5e26-4463-aad2-8a10df52fcde tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:40.786886 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ca2e6867-5e26-4463-aad2-8a10df52fcde tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:40.786886 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ca2e6867-5e26-4463-aad2-8a10df52fcde tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:40.928141 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-95f58e29-ca4a-48bd-ab2c-2ef1794ebf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:40.928780 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-95f58e29-ca4a-48bd-ab2c-2ef1794ebf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:40.936975 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-95f58e29-ca4a-48bd-ab2c-2ef1794ebf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:40.937388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ca2e6867-5e26-4463-aad2-8a10df52fcde tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:40.938023 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-95f58e29-ca4a-48bd-ab2c-2ef1794ebf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:40.938994 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-95f58e29-ca4a-48bd-ab2c-2ef1794ebf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:40.940303 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-95f58e29-ca4a-48bd-ab2c-2ef1794ebf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:40.947692 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ca2e6867-5e26-4463-aad2-8a10df52fcde tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:40.949654 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ca2e6867-5e26-4463-aad2-8a10df52fcde tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:40.951110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ca2e6867-5e26-4463-aad2-8a10df52fcde tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.181340 Jun 02 14:04:40.952439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 466/956] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:40 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:41.013685 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-95f58e29-ca4a-48bd-ab2c-2ef1794ebf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:41.024981 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-95f58e29-ca4a-48bd-ab2c-2ef1794ebf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1210 microversion: 2.1 time: 0.102093 Jun 02 14:04:41.037123 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 491/957] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:40 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1210 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:04:41.968831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0abe2453-f63e-4b1a-b151-78cb5a01c450 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:41.970066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0abe2453-f63e-4b1a-b151-78cb5a01c450 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:41.978280 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0abe2453-f63e-4b1a-b151-78cb5a01c450 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:41.981708 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0abe2453-f63e-4b1a-b151-78cb5a01c450 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:41.981708 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0abe2453-f63e-4b1a-b151-78cb5a01c450 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:41.981708 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0abe2453-f63e-4b1a-b151-78cb5a01c450 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:42.047269 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-706d12f8-c50c-4bb2-a0ef-f6259e5185cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:42.049273 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-706d12f8-c50c-4bb2-a0ef-f6259e5185cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:42.056480 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-706d12f8-c50c-4bb2-a0ef-f6259e5185cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:42.057245 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-706d12f8-c50c-4bb2-a0ef-f6259e5185cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:42.058967 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-706d12f8-c50c-4bb2-a0ef-f6259e5185cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:42.059563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-706d12f8-c50c-4bb2-a0ef-f6259e5185cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:42.247856 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0abe2453-f63e-4b1a-b151-78cb5a01c450 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:42.257952 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0abe2453-f63e-4b1a-b151-78cb5a01c450 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:42.262819 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0abe2453-f63e-4b1a-b151-78cb5a01c450 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:42.270377 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0abe2453-f63e-4b1a-b151-78cb5a01c450 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.305378 Jun 02 14:04:42.271602 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 467/958] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:41 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:42.302947 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-706d12f8-c50c-4bb2-a0ef-f6259e5185cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:42.316894 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-706d12f8-c50c-4bb2-a0ef-f6259e5185cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1277 microversion: 2.1 time: 0.277478 Jun 02 14:04:42.318110 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 492/959] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:42 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1277 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:04:42.484927 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-096fa0b5-db74-49d3-88e5-245d154701e4 req-eff33564-c07a-41ae-bc2f-c9809c44abbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53c5aefc-4310-48eb-87c7-de7e8846e33a", "tag": "cf30a33b-364e-4150-81f4-9ce2821f6b5d"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:04:42.495534 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-096fa0b5-db74-49d3-88e5-245d154701e4 req-eff33564-c07a-41ae-bc2f-c9809c44abbe service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:42.496005 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-096fa0b5-db74-49d3-88e5-245d154701e4 req-eff33564-c07a-41ae-bc2f-c9809c44abbe service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:42.512192 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-096fa0b5-db74-49d3-88e5-245d154701e4 req-eff33564-c07a-41ae-bc2f-c9809c44abbe service nova] Creating event network-changed:cf30a33b-364e-4150-81f4-9ce2821f6b5d for instance 53c5aefc-4310-48eb-87c7-de7e8846e33a on hv-cinder-82651 Jun 02 14:04:42.518680 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-096fa0b5-db74-49d3-88e5-245d154701e4 req-eff33564-c07a-41ae-bc2f-c9809c44abbe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040937 Jun 02 14:04:42.523701 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 468/960] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:04:43.289709 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d2046f4c-29ea-4325-afb6-2363ab127eaa tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:43.290902 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d2046f4c-29ea-4325-afb6-2363ab127eaa tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:43.297551 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d2046f4c-29ea-4325-afb6-2363ab127eaa tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:43.298005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d2046f4c-29ea-4325-afb6-2363ab127eaa tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:43.299665 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d2046f4c-29ea-4325-afb6-2363ab127eaa tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:43.300101 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d2046f4c-29ea-4325-afb6-2363ab127eaa tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:43.335740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7b27e28f-8766-4a7b-a3f1-b0b95a93056f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:43.336807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7b27e28f-8766-4a7b-a3f1-b0b95a93056f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:43.346729 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7b27e28f-8766-4a7b-a3f1-b0b95a93056f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:43.347437 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7b27e28f-8766-4a7b-a3f1-b0b95a93056f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:43.348302 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7b27e28f-8766-4a7b-a3f1-b0b95a93056f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:43.348850 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7b27e28f-8766-4a7b-a3f1-b0b95a93056f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:43.480416 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d2046f4c-29ea-4325-afb6-2363ab127eaa tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:43.499091 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d2046f4c-29ea-4325-afb6-2363ab127eaa tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:43.499091 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d2046f4c-29ea-4325-afb6-2363ab127eaa tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:43.499404 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d2046f4c-29ea-4325-afb6-2363ab127eaa tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.213589 Jun 02 14:04:43.499859 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 493/961] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:43 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:43.525660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7b27e28f-8766-4a7b-a3f1-b0b95a93056f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:43.534624 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7b27e28f-8766-4a7b-a3f1-b0b95a93056f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.203590 Jun 02 14:04:43.535286 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 469/962] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:43 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:04:44.523818 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c36b9eeb-388c-4caf-92bc-9f665168febe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:44.524464 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c36b9eeb-388c-4caf-92bc-9f665168febe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:44.530893 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c36b9eeb-388c-4caf-92bc-9f665168febe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:44.531339 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c36b9eeb-388c-4caf-92bc-9f665168febe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:44.532095 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c36b9eeb-388c-4caf-92bc-9f665168febe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:44.532558 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c36b9eeb-388c-4caf-92bc-9f665168febe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:44.553650 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-82751bec-4252-46ef-99ce-162985a4fbeb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:44.553650 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-82751bec-4252-46ef-99ce-162985a4fbeb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:44.560815 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-82751bec-4252-46ef-99ce-162985a4fbeb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:44.561526 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-82751bec-4252-46ef-99ce-162985a4fbeb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:44.562309 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-82751bec-4252-46ef-99ce-162985a4fbeb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:44.562746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-82751bec-4252-46ef-99ce-162985a4fbeb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:44.743638 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-82751bec-4252-46ef-99ce-162985a4fbeb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:44.746445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c36b9eeb-388c-4caf-92bc-9f665168febe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:44.751281 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-82751bec-4252-46ef-99ce-162985a4fbeb tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.203863 Jun 02 14:04:44.752384 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 470/963] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:44 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:04:44.755389 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c36b9eeb-388c-4caf-92bc-9f665168febe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:44.756930 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c36b9eeb-388c-4caf-92bc-9f665168febe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:44.758089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c36b9eeb-388c-4caf-92bc-9f665168febe tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.238346 Jun 02 14:04:44.758646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 494/964] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:44 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:45.769098 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-00579566-d8c5-4d13-9aa7-951629100701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:45.769646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-00579566-d8c5-4d13-9aa7-951629100701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:45.776289 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00579566-d8c5-4d13-9aa7-951629100701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:45.776773 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00579566-d8c5-4d13-9aa7-951629100701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:45.776981 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-bbda62b2-b4f2-4b59-bb22-6c7f813db31c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:45.777536 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00579566-d8c5-4d13-9aa7-951629100701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:45.777648 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-bbda62b2-b4f2-4b59-bb22-6c7f813db31c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:45.777976 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-00579566-d8c5-4d13-9aa7-951629100701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:45.784014 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bbda62b2-b4f2-4b59-bb22-6c7f813db31c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:45.784492 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bbda62b2-b4f2-4b59-bb22-6c7f813db31c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:45.785347 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bbda62b2-b4f2-4b59-bb22-6c7f813db31c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:45.785757 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bbda62b2-b4f2-4b59-bb22-6c7f813db31c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:45.977577 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-bbda62b2-b4f2-4b59-bb22-6c7f813db31c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:45.981143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-00579566-d8c5-4d13-9aa7-951629100701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:45.985940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-bbda62b2-b4f2-4b59-bb22-6c7f813db31c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:45.987537 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-bbda62b2-b4f2-4b59-bb22-6c7f813db31c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:45.989281 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-00579566-d8c5-4d13-9aa7-951629100701 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.224078 Jun 02 14:04:45.989409 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-bbda62b2-b4f2-4b59-bb22-6c7f813db31c tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1740 microversion: 2.20 time: 0.216179 Jun 02 14:04:45.994176 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 471/965] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:45 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:04:45.994333 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 495/966] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:45 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:04:47.007616 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a3541b31-c008-4992-96aa-94afd1347d8b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:47.008183 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8e38def8-1809-482c-931e-84bade4abef7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:47.008592 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a3541b31-c008-4992-96aa-94afd1347d8b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:47.008695 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8e38def8-1809-482c-931e-84bade4abef7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:47.014850 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a3541b31-c008-4992-96aa-94afd1347d8b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:47.015012 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e38def8-1809-482c-931e-84bade4abef7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:47.015299 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e38def8-1809-482c-931e-84bade4abef7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:47.015412 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a3541b31-c008-4992-96aa-94afd1347d8b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:47.016056 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e38def8-1809-482c-931e-84bade4abef7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:47.016161 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a3541b31-c008-4992-96aa-94afd1347d8b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:47.016510 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e38def8-1809-482c-931e-84bade4abef7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:47.016618 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a3541b31-c008-4992-96aa-94afd1347d8b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:47.104426 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=2 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:47.125162 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=6 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:47.214456 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a3541b31-c008-4992-96aa-94afd1347d8b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:47.218437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8e38def8-1809-482c-931e-84bade4abef7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:47.222090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a3541b31-c008-4992-96aa-94afd1347d8b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.219599 Jun 02 14:04:47.222865 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 472/967] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:47 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:04:47.226902 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8e38def8-1809-482c-931e-84bade4abef7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:47.228436 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8e38def8-1809-482c-931e-84bade4abef7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:47.229607 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8e38def8-1809-482c-931e-84bade4abef7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1722 microversion: 2.20 time: 0.226175 Jun 02 14:04:47.230164 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 496/968] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:47 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:04:48.239509 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c4501876-bdef-4fa0-9cd1-417119e50c0e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:48.240123 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c4501876-bdef-4fa0-9cd1-417119e50c0e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:48.247281 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c4501876-bdef-4fa0-9cd1-417119e50c0e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:48.248348 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c4501876-bdef-4fa0-9cd1-417119e50c0e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:48.248589 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c4501876-bdef-4fa0-9cd1-417119e50c0e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:48.248715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-191726e4-046a-4afe-9787-8a04c6f4d93b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:48.249134 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c4501876-bdef-4fa0-9cd1-417119e50c0e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:48.249234 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-191726e4-046a-4afe-9787-8a04c6f4d93b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:48.252082 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:48.256639 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-191726e4-046a-4afe-9787-8a04c6f4d93b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:48.257089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-191726e4-046a-4afe-9787-8a04c6f4d93b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:48.257852 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-191726e4-046a-4afe-9787-8a04c6f4d93b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:48.258292 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-191726e4-046a-4afe-9787-8a04c6f4d93b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:48.472191 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c4501876-bdef-4fa0-9cd1-417119e50c0e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:48.475412 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-191726e4-046a-4afe-9787-8a04c6f4d93b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:48.480215 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c4501876-bdef-4fa0-9cd1-417119e50c0e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.244704 Jun 02 14:04:48.481678 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 473/969] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:48 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:04:48.486266 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-191726e4-046a-4afe-9787-8a04c6f4d93b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:48.487783 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-191726e4-046a-4afe-9787-8a04c6f4d93b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:48.489238 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-191726e4-046a-4afe-9787-8a04c6f4d93b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1722 microversion: 2.20 time: 0.244610 Jun 02 14:04:48.489977 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 497/970] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:48 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:48.808649 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-e52298d9-26bc-4331-9417-33bd71c5afd6 req-cb08062c-8c23-47a6-b266-4b48bfd0e184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96011da5-6967-44e1-af2c-2ad76c52da74", "name": "network-vif-unplugged", "status": "completed", "tag": "ef61b669-91ec-4f6a-b126-1de24442c7c0"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:04:48.817285 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-e52298d9-26bc-4331-9417-33bd71c5afd6 req-cb08062c-8c23-47a6-b266-4b48bfd0e184 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:48.817923 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-e52298d9-26bc-4331-9417-33bd71c5afd6 req-cb08062c-8c23-47a6-b266-4b48bfd0e184 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:48.829210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-e52298d9-26bc-4331-9417-33bd71c5afd6 req-cb08062c-8c23-47a6-b266-4b48bfd0e184 service nova] Creating event network-vif-unplugged:ef61b669-91ec-4f6a-b126-1de24442c7c0 for instance 96011da5-6967-44e1-af2c-2ad76c52da74 on hv-cinder-82651 Jun 02 14:04:48.834689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-e52298d9-26bc-4331-9417-33bd71c5afd6 req-cb08062c-8c23-47a6-b266-4b48bfd0e184 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029826 Jun 02 14:04:48.839288 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 474/971] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:04:49.497435 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-27f88538-0391-4a75-ac23-f466f8c8f01b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:49.498083 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-27f88538-0391-4a75-ac23-f466f8c8f01b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:49.505231 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-27f88538-0391-4a75-ac23-f466f8c8f01b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:49.505679 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-27f88538-0391-4a75-ac23-f466f8c8f01b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:49.506443 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-27f88538-0391-4a75-ac23-f466f8c8f01b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:49.506875 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-27f88538-0391-4a75-ac23-f466f8c8f01b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:49.514634 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5b113d41-35a2-490e-863e-68123192f20a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:49.514634 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5b113d41-35a2-490e-863e-68123192f20a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:49.515413 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5b113d41-35a2-490e-863e-68123192f20a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:49.515855 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5b113d41-35a2-490e-863e-68123192f20a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:49.516650 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5b113d41-35a2-490e-863e-68123192f20a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:49.517075 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5b113d41-35a2-490e-863e-68123192f20a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:49.727261 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-27f88538-0391-4a75-ac23-f466f8c8f01b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:49.731020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5b113d41-35a2-490e-863e-68123192f20a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:49.734765 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-27f88538-0391-4a75-ac23-f466f8c8f01b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.241257 Jun 02 14:04:49.735342 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 498/972] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:49 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:04:49.742329 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5b113d41-35a2-490e-863e-68123192f20a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:49.743896 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5b113d41-35a2-490e-863e-68123192f20a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:49.745111 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5b113d41-35a2-490e-863e-68123192f20a tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1725 microversion: 2.20 time: 0.241849 Jun 02 14:04:49.745674 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 475/973] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:49 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:04:49.766860 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-71ac9431-fa8e-4714-8364-f23bbbfb8f0f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c542068-01ad-4f6b-8848-6bc659fe53f7"}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:04:49.767976 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-71ac9431-fa8e-4714-8364-f23bbbfb8f0f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:49.774624 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-71ac9431-fa8e-4714-8364-f23bbbfb8f0f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:49.775074 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-71ac9431-fa8e-4714-8364-f23bbbfb8f0f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:49.775831 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-71ac9431-fa8e-4714-8364-f23bbbfb8f0f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:49.776259 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-71ac9431-fa8e-4714-8364-f23bbbfb8f0f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:49.792888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=100 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:50.751837 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4fda8099-b57b-4a44-ad86-1a6aad2378cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:50.752466 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4fda8099-b57b-4a44-ad86-1a6aad2378cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:50.759047 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4fda8099-b57b-4a44-ad86-1a6aad2378cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:50.759487 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4fda8099-b57b-4a44-ad86-1a6aad2378cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:50.760233 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4fda8099-b57b-4a44-ad86-1a6aad2378cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:50.760706 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4fda8099-b57b-4a44-ad86-1a6aad2378cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:50.898700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4fda8099-b57b-4a44-ad86-1a6aad2378cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:50.902211 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=100 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:50.906550 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4fda8099-b57b-4a44-ad86-1a6aad2378cf tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.158830 Jun 02 14:04:50.907107 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 476/974] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:50 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:04:50.912980 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-71ac9431-fa8e-4714-8364-f23bbbfb8f0f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "POST /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.150018 Jun 02 14:04:50.914140 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 499/975] 10.222.0.33 () {62 vars in 1363 bytes} [Thu Jun 2 14:04:49 2022] POST /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74/os-volume_attachments => generated 188 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 14:04:51.039777 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e7b1cbd2-8d3c-4e7d-9e9a-a3f18618d3b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:51.040300 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e7b1cbd2-8d3c-4e7d-9e9a-a3f18618d3b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:51.046443 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7b1cbd2-8d3c-4e7d-9e9a-a3f18618d3b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:51.051276 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7b1cbd2-8d3c-4e7d-9e9a-a3f18618d3b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:51.051276 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7b1cbd2-8d3c-4e7d-9e9a-a3f18618d3b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:51.051276 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7b1cbd2-8d3c-4e7d-9e9a-a3f18618d3b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:51.693501 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e7b1cbd2-8d3c-4e7d-9e9a-a3f18618d3b7 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "DELETE /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74/os-volume_attachments/4c542068-01ad-4f6b-8848-6bc659fe53f7" status: 202 len: 0 microversion: 2.20 time: 0.658789 Jun 02 14:04:51.694053 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 477/976] 10.222.0.33 () {60 vars in 1456 bytes} [Thu Jun 2 14:04:51 2022] DELETE /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74/os-volume_attachments/4c542068-01ad-4f6b-8848-6bc659fe53f7 => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:04:51.750031 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ed309725-ecbf-4e77-abd3-200cb557f7b1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:04:51.750598 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ed309725-ecbf-4e77-abd3-200cb557f7b1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:51.758647 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ed309725-ecbf-4e77-abd3-200cb557f7b1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:51.759098 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ed309725-ecbf-4e77-abd3-200cb557f7b1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:51.759867 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ed309725-ecbf-4e77-abd3-200cb557f7b1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:51.760303 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ed309725-ecbf-4e77-abd3-200cb557f7b1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:51.923861 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c5801881-ff55-4be0-bb84-ef943bb5d0c9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:51.924519 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c5801881-ff55-4be0-bb84-ef943bb5d0c9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:51.932544 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c5801881-ff55-4be0-bb84-ef943bb5d0c9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:51.932997 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c5801881-ff55-4be0-bb84-ef943bb5d0c9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:51.933833 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c5801881-ff55-4be0-bb84-ef943bb5d0c9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:51.934286 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c5801881-ff55-4be0-bb84-ef943bb5d0c9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:52.024177 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ed309725-ecbf-4e77-abd3-200cb557f7b1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "POST /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74/action" status: 202 len: 0 microversion: 2.20 time: 0.277968 Jun 02 14:04:52.025434 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 500/977] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 2 14:04:51 2022] POST /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:04:52.033475 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-da5204f2-8dbe-428c-8740-cf9476961a8d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:52.034118 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-da5204f2-8dbe-428c-8740-cf9476961a8d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:52.041036 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-da5204f2-8dbe-428c-8740-cf9476961a8d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:52.041790 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-da5204f2-8dbe-428c-8740-cf9476961a8d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:52.042242 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-da5204f2-8dbe-428c-8740-cf9476961a8d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:52.042672 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-da5204f2-8dbe-428c-8740-cf9476961a8d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:52.075913 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c5801881-ff55-4be0-bb84-ef943bb5d0c9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:52.083883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c5801881-ff55-4be0-bb84-ef943bb5d0c9 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.163956 Jun 02 14:04:52.084786 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 478/978] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:51 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:04:52.174076 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-da5204f2-8dbe-428c-8740-cf9476961a8d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:52.182982 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-da5204f2-8dbe-428c-8740-cf9476961a8d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:52.184492 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-da5204f2-8dbe-428c-8740-cf9476961a8d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:52.185740 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-da5204f2-8dbe-428c-8740-cf9476961a8d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1673 microversion: 2.20 time: 0.156144 Jun 02 14:04:52.186495 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 501/979] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:52 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:04:53.101286 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d5076893-0cca-4a68-9d37-75f90d46527f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:53.101838 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d5076893-0cca-4a68-9d37-75f90d46527f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:53.108337 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d5076893-0cca-4a68-9d37-75f90d46527f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:53.108825 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d5076893-0cca-4a68-9d37-75f90d46527f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:53.109589 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d5076893-0cca-4a68-9d37-75f90d46527f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:53.110025 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d5076893-0cca-4a68-9d37-75f90d46527f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:53.203204 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a38cc5cb-f8a2-4588-ad43-49be4f6a8a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:53.203819 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a38cc5cb-f8a2-4588-ad43-49be4f6a8a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:53.210830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a38cc5cb-f8a2-4588-ad43-49be4f6a8a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:53.211277 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a38cc5cb-f8a2-4588-ad43-49be4f6a8a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:53.212038 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a38cc5cb-f8a2-4588-ad43-49be4f6a8a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:53.212885 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a38cc5cb-f8a2-4588-ad43-49be4f6a8a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:53.266872 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d5076893-0cca-4a68-9d37-75f90d46527f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:53.274836 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d5076893-0cca-4a68-9d37-75f90d46527f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.177797 Jun 02 14:04:53.275418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 479/980] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:53 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:04:53.350220 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a38cc5cb-f8a2-4588-ad43-49be4f6a8a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:53.360608 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a38cc5cb-f8a2-4588-ad43-49be4f6a8a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:53.362057 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a38cc5cb-f8a2-4588-ad43-49be4f6a8a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:53.364024 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a38cc5cb-f8a2-4588-ad43-49be4f6a8a52 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1673 microversion: 2.20 time: 0.164145 Jun 02 14:04:53.364622 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 502/981] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:53 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:04:53.818601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-551d2d32-5226-4eeb-aba0-33e2718b0b35 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:53.819096 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-551d2d32-5226-4eeb-aba0-33e2718b0b35 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:53.825371 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-551d2d32-5226-4eeb-aba0-33e2718b0b35 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:53.825818 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-551d2d32-5226-4eeb-aba0-33e2718b0b35 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:53.826574 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-551d2d32-5226-4eeb-aba0-33e2718b0b35 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:53.827009 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-551d2d32-5226-4eeb-aba0-33e2718b0b35 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:53.851206 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-551d2d32-5226-4eeb-aba0-33e2718b0b35 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/ips" status: 200 len: 146 microversion: 2.1 time: 0.036676 Jun 02 14:04:53.851777 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 480/982] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 2 14:04:53 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:04:54.293290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-49a18d50-fe07-4d27-b8e8-b3b04570afa8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:54.294204 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-49a18d50-fe07-4d27-b8e8-b3b04570afa8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:54.302142 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-49a18d50-fe07-4d27-b8e8-b3b04570afa8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:54.308460 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-49a18d50-fe07-4d27-b8e8-b3b04570afa8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:54.308460 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-49a18d50-fe07-4d27-b8e8-b3b04570afa8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:54.308460 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-49a18d50-fe07-4d27-b8e8-b3b04570afa8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:54.382649 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-98038a83-7c81-4b8f-bc9b-2887439a0c3b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:54.383263 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-98038a83-7c81-4b8f-bc9b-2887439a0c3b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:54.391132 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-98038a83-7c81-4b8f-bc9b-2887439a0c3b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:54.391592 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-98038a83-7c81-4b8f-bc9b-2887439a0c3b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:54.392363 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-98038a83-7c81-4b8f-bc9b-2887439a0c3b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:54.392822 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-98038a83-7c81-4b8f-bc9b-2887439a0c3b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:54.455270 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-49a18d50-fe07-4d27-b8e8-b3b04570afa8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:54.464448 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-49a18d50-fe07-4d27-b8e8-b3b04570afa8 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.176068 Jun 02 14:04:54.465082 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 503/983] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:54 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:04:54.543374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-98038a83-7c81-4b8f-bc9b-2887439a0c3b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:54.552527 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-98038a83-7c81-4b8f-bc9b-2887439a0c3b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:54.554276 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-98038a83-7c81-4b8f-bc9b-2887439a0c3b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:54.555639 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-98038a83-7c81-4b8f-bc9b-2887439a0c3b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1731 microversion: 2.20 time: 0.177732 Jun 02 14:04:54.562944 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 481/984] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:54 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:55.030277 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-cfeecef1-7d63-48cc-ba0d-060471a81d6b req-e3329508-c677-4f2b-96d9-f2c790e1a387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53c5aefc-4310-48eb-87c7-de7e8846e33a", "name": "network-vif-plugged", "status": "completed", "tag": "cf30a33b-364e-4150-81f4-9ce2821f6b5d"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:04:55.039565 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-cfeecef1-7d63-48cc-ba0d-060471a81d6b req-e3329508-c677-4f2b-96d9-f2c790e1a387 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:55.040009 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-cfeecef1-7d63-48cc-ba0d-060471a81d6b req-e3329508-c677-4f2b-96d9-f2c790e1a387 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:55.050671 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-cfeecef1-7d63-48cc-ba0d-060471a81d6b req-e3329508-c677-4f2b-96d9-f2c790e1a387 service nova] Creating event network-vif-plugged:cf30a33b-364e-4150-81f4-9ce2821f6b5d for instance 53c5aefc-4310-48eb-87c7-de7e8846e33a on hv-cinder-82651 Jun 02 14:04:55.057004 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-cfeecef1-7d63-48cc-ba0d-060471a81d6b req-e3329508-c677-4f2b-96d9-f2c790e1a387 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030338 Jun 02 14:04:55.057569 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 504/985] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:04:55.481465 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-cc3bd8ad-79c2-4984-b12a-0f21bb282111 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:55.482082 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-cc3bd8ad-79c2-4984-b12a-0f21bb282111 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:55.489183 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cc3bd8ad-79c2-4984-b12a-0f21bb282111 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:55.489772 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cc3bd8ad-79c2-4984-b12a-0f21bb282111 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:55.490536 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cc3bd8ad-79c2-4984-b12a-0f21bb282111 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:55.490965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-cc3bd8ad-79c2-4984-b12a-0f21bb282111 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:55.576104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7ae144d5-3119-4e51-b56c-61fa18eca20f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:55.576994 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7ae144d5-3119-4e51-b56c-61fa18eca20f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:55.598859 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ae144d5-3119-4e51-b56c-61fa18eca20f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:55.599467 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ae144d5-3119-4e51-b56c-61fa18eca20f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:55.600256 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ae144d5-3119-4e51-b56c-61fa18eca20f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:55.604932 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ae144d5-3119-4e51-b56c-61fa18eca20f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:55.693548 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-cc3bd8ad-79c2-4984-b12a-0f21bb282111 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:55.704302 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-cc3bd8ad-79c2-4984-b12a-0f21bb282111 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.226507 Jun 02 14:04:55.705407 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 482/986] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:55 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:04:55.774188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-30a6f966-c1f3-4f8f-ab7f-d8e5d4b98c0e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:55.775106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-30a6f966-c1f3-4f8f-ab7f-d8e5d4b98c0e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:55.782647 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-30a6f966-c1f3-4f8f-ab7f-d8e5d4b98c0e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:55.784276 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-30a6f966-c1f3-4f8f-ab7f-d8e5d4b98c0e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:55.785583 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-30a6f966-c1f3-4f8f-ab7f-d8e5d4b98c0e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:55.786892 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-30a6f966-c1f3-4f8f-ab7f-d8e5d4b98c0e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:55.822932 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-30a6f966-c1f3-4f8f-ab7f-d8e5d4b98c0e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/ips" status: 200 len: 150 microversion: 2.1 time: 0.055570 Jun 02 14:04:55.823793 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 483/987] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 2 14:04:55 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/ips => generated 150 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:04:55.870947 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7ae144d5-3119-4e51-b56c-61fa18eca20f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:55.885686 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7ae144d5-3119-4e51-b56c-61fa18eca20f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:55.888437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7ae144d5-3119-4e51-b56c-61fa18eca20f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:55.890079 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7ae144d5-3119-4e51-b56c-61fa18eca20f tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1731 microversion: 2.20 time: 0.318049 Jun 02 14:04:55.891332 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 505/988] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:55 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1731 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:04:56.722625 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-303a84ec-e07d-41c9-9aa2-b6793d9d2a1a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:56.723935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-303a84ec-e07d-41c9-9aa2-b6793d9d2a1a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:56.730418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-303a84ec-e07d-41c9-9aa2-b6793d9d2a1a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:56.730882 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-303a84ec-e07d-41c9-9aa2-b6793d9d2a1a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:56.731616 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-303a84ec-e07d-41c9-9aa2-b6793d9d2a1a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:56.732047 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-303a84ec-e07d-41c9-9aa2-b6793d9d2a1a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:56.862039 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-303a84ec-e07d-41c9-9aa2-b6793d9d2a1a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:56.870292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-303a84ec-e07d-41c9-9aa2-b6793d9d2a1a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.151691 Jun 02 14:04:56.870847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 484/989] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:56 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:04:56.909179 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f6f26cb1-4d99-46ed-b302-8592a78ab5e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:56.909789 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f6f26cb1-4d99-46ed-b302-8592a78ab5e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:56.917427 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f6f26cb1-4d99-46ed-b302-8592a78ab5e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:56.917930 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f6f26cb1-4d99-46ed-b302-8592a78ab5e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:56.918689 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f6f26cb1-4d99-46ed-b302-8592a78ab5e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:56.919121 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f6f26cb1-4d99-46ed-b302-8592a78ab5e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:57.052348 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f6f26cb1-4d99-46ed-b302-8592a78ab5e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:57.060166 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f6f26cb1-4d99-46ed-b302-8592a78ab5e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:57.061707 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f6f26cb1-4d99-46ed-b302-8592a78ab5e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:57.062843 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f6f26cb1-4d99-46ed-b302-8592a78ab5e4 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1731 microversion: 2.20 time: 0.157534 Jun 02 14:04:57.063395 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 506/990] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:56 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:04:57.587499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-18630086-41cf-4ae0-b43d-b1e1d97a3037 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9207a8ea-9ef6-4683-925a-ec08f911e8b5"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:04:57.588685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-18630086-41cf-4ae0-b43d-b1e1d97a3037 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:57.594710 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-18630086-41cf-4ae0-b43d-b1e1d97a3037 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:57.595150 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-18630086-41cf-4ae0-b43d-b1e1d97a3037 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:57.595897 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-18630086-41cf-4ae0-b43d-b1e1d97a3037 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:57.596326 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-18630086-41cf-4ae0-b43d-b1e1d97a3037 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:57.886649 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-89c70f68-e851-4443-b552-c5905e5ea170 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:57.887172 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-89c70f68-e851-4443-b552-c5905e5ea170 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:57.893362 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-89c70f68-e851-4443-b552-c5905e5ea170 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:57.893811 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-89c70f68-e851-4443-b552-c5905e5ea170 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:57.894617 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-89c70f68-e851-4443-b552-c5905e5ea170 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:57.895156 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-89c70f68-e851-4443-b552-c5905e5ea170 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:58.030447 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-89c70f68-e851-4443-b552-c5905e5ea170 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:58.039076 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-89c70f68-e851-4443-b552-c5905e5ea170 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.156292 Jun 02 14:04:58.039898 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 507/991] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:04:57 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:04:58.081003 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-fb99b895-b33b-4e9d-919c-91b86d23709d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:04:58.081614 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-fb99b895-b33b-4e9d-919c-91b86d23709d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:58.088502 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fb99b895-b33b-4e9d-919c-91b86d23709d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:58.088502 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fb99b895-b33b-4e9d-919c-91b86d23709d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:58.089075 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fb99b895-b33b-4e9d-919c-91b86d23709d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:58.089510 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fb99b895-b33b-4e9d-919c-91b86d23709d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:58.224387 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-fb99b895-b33b-4e9d-919c-91b86d23709d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:58.232944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-fb99b895-b33b-4e9d-919c-91b86d23709d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:58.237048 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-fb99b895-b33b-4e9d-919c-91b86d23709d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:04:58.237048 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-fb99b895-b33b-4e9d-919c-91b86d23709d tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1731 microversion: 2.20 time: 0.158576 Jun 02 14:04:58.237048 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 508/992] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:04:58 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:04:58.581928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b4f5c25f-efde-4365-ae4c-f87e5d2b5fa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5afcebe3-d510-4c2b-a2bd-ecaced2eea66"}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:04:58.583592 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b4f5c25f-efde-4365-ae4c-f87e5d2b5fa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:04:58.589688 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b4f5c25f-efde-4365-ae4c-f87e5d2b5fa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:58.590132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b4f5c25f-efde-4365-ae4c-f87e5d2b5fa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:04:58.590890 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b4f5c25f-efde-4365-ae4c-f87e5d2b5fa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:04:58.591325 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b4f5c25f-efde-4365-ae4c-f87e5d2b5fa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:07.592931 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:07.667211 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:08.587547 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=55 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:08.662345 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:18.919786 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-18630086-41cf-4ae0-b43d-b1e1d97a3037 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "POST /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 21.336062 Jun 02 14:05:18.920619 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 485/993] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 2 14:04:57 2022] POST /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/os-volume_attachments => generated 194 bytes in 21338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:05:18.926033 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0a222ea9-51ea-4858-8b77-b9f39fa4f452 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:18.926760 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0a222ea9-51ea-4858-8b77-b9f39fa4f452 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:18.941042 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0a222ea9-51ea-4858-8b77-b9f39fa4f452 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:18.941042 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0a222ea9-51ea-4858-8b77-b9f39fa4f452 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:18.941470 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b4f5c25f-efde-4365-ae4c-f87e5d2b5fa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "POST /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 20.357307 Jun 02 14:05:18.941942 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0a222ea9-51ea-4858-8b77-b9f39fa4f452 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:18.941942 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0a222ea9-51ea-4858-8b77-b9f39fa4f452 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:18.943610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 509/994] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 2 14:04:58 2022] POST /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-volume_attachments => generated 194 bytes in 20366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:05:18.951086 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-cec4fd94-b8b0-4e41-a4f2-1bfe83da0498 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:18.953734 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-cec4fd94-b8b0-4e41-a4f2-1bfe83da0498 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:18.970282 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cec4fd94-b8b0-4e41-a4f2-1bfe83da0498 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:18.970282 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cec4fd94-b8b0-4e41-a4f2-1bfe83da0498 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:18.970282 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cec4fd94-b8b0-4e41-a4f2-1bfe83da0498 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:18.970282 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cec4fd94-b8b0-4e41-a4f2-1bfe83da0498 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:19.172142 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-cec4fd94-b8b0-4e41-a4f2-1bfe83da0498 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:19.173144 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0a222ea9-51ea-4858-8b77-b9f39fa4f452 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:19.196815 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-cec4fd94-b8b0-4e41-a4f2-1bfe83da0498 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:19.198067 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-cec4fd94-b8b0-4e41-a4f2-1bfe83da0498 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:19.199445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-cec4fd94-b8b0-4e41-a4f2-1bfe83da0498 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1731 microversion: 2.20 time: 0.254378 Jun 02 14:05:19.199766 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0a222ea9-51ea-4858-8b77-b9f39fa4f452 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.277817 Jun 02 14:05:19.200432 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 510/995] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:05:18 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:05:19.201226 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 486/996] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:18 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:20.229498 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f7123cb0-4bed-4e95-abea-51cc512c4d4f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:20.230149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f7123cb0-4bed-4e95-abea-51cc512c4d4f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:20.233868 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6efa0cb9-a959-490f-a84e-2113aaccf2c3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:20.234485 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6efa0cb9-a959-490f-a84e-2113aaccf2c3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:20.236951 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f7123cb0-4bed-4e95-abea-51cc512c4d4f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:20.237478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f7123cb0-4bed-4e95-abea-51cc512c4d4f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:20.238317 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f7123cb0-4bed-4e95-abea-51cc512c4d4f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:20.238808 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f7123cb0-4bed-4e95-abea-51cc512c4d4f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:20.247929 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6efa0cb9-a959-490f-a84e-2113aaccf2c3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:20.252569 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6efa0cb9-a959-490f-a84e-2113aaccf2c3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:20.253352 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6efa0cb9-a959-490f-a84e-2113aaccf2c3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:20.253842 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6efa0cb9-a959-490f-a84e-2113aaccf2c3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:20.454852 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f7123cb0-4bed-4e95-abea-51cc512c4d4f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:20.462348 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6efa0cb9-a959-490f-a84e-2113aaccf2c3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:20.465266 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f7123cb0-4bed-4e95-abea-51cc512c4d4f tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1265 microversion: 2.1 time: 0.240192 Jun 02 14:05:20.466369 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 487/997] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:20 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:05:20.480145 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6efa0cb9-a959-490f-a84e-2113aaccf2c3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:20.481657 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6efa0cb9-a959-490f-a84e-2113aaccf2c3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:20.482816 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6efa0cb9-a959-490f-a84e-2113aaccf2c3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1731 microversion: 2.20 time: 0.258546 Jun 02 14:05:20.483374 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 511/998] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:05:20 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1731 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:05:21.238643 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-058cd820-803e-4a6f-8ddb-768d747645ae req-1fa1ae24-1419-4c94-bacd-568c5671fdb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96011da5-6967-44e1-af2c-2ad76c52da74", "name": "network-vif-plugged", "status": "completed", "tag": "ef61b669-91ec-4f6a-b126-1de24442c7c0"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:05:21.246999 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-058cd820-803e-4a6f-8ddb-768d747645ae req-1fa1ae24-1419-4c94-bacd-568c5671fdb6 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:21.248071 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-058cd820-803e-4a6f-8ddb-768d747645ae req-1fa1ae24-1419-4c94-bacd-568c5671fdb6 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:21.258793 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-058cd820-803e-4a6f-8ddb-768d747645ae req-1fa1ae24-1419-4c94-bacd-568c5671fdb6 service nova] Creating event network-vif-plugged:ef61b669-91ec-4f6a-b126-1de24442c7c0 for instance 96011da5-6967-44e1-af2c-2ad76c52da74 on hv-cinder-82651 Jun 02 14:05:21.263669 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-058cd820-803e-4a6f-8ddb-768d747645ae req-1fa1ae24-1419-4c94-bacd-568c5671fdb6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152380 Jun 02 14:05:21.264365 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 488/999] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:05:21.483030 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-126d9f10-4d8d-42e5-9c1e-f88594cf0322 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:21.483574 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-126d9f10-4d8d-42e5-9c1e-f88594cf0322 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:21.490390 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-126d9f10-4d8d-42e5-9c1e-f88594cf0322 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:21.490839 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-126d9f10-4d8d-42e5-9c1e-f88594cf0322 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:21.491608 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-126d9f10-4d8d-42e5-9c1e-f88594cf0322 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:21.492093 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-126d9f10-4d8d-42e5-9c1e-f88594cf0322 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:21.502561 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-75c0ab6d-73ce-4273-9cc4-1b5d13cfcca9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:21.503275 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-75c0ab6d-73ce-4273-9cc4-1b5d13cfcca9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:21.511692 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-75c0ab6d-73ce-4273-9cc4-1b5d13cfcca9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:21.512226 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-75c0ab6d-73ce-4273-9cc4-1b5d13cfcca9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:21.513106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-75c0ab6d-73ce-4273-9cc4-1b5d13cfcca9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:21.513700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-75c0ab6d-73ce-4273-9cc4-1b5d13cfcca9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:21.710051 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-126d9f10-4d8d-42e5-9c1e-f88594cf0322 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:21.713360 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-75c0ab6d-73ce-4273-9cc4-1b5d13cfcca9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:21.717705 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-126d9f10-4d8d-42e5-9c1e-f88594cf0322 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1451 microversion: 2.1 time: 0.238666 Jun 02 14:05:21.718529 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 512/1000] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:21 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1451 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:21.721968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-75c0ab6d-73ce-4273-9cc4-1b5d13cfcca9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:21.723514 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-75c0ab6d-73ce-4273-9cc4-1b5d13cfcca9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:21.724794 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-75c0ab6d-73ce-4273-9cc4-1b5d13cfcca9 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1731 microversion: 2.20 time: 0.226499 Jun 02 14:05:21.725343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 489/1001] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:05:21 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 14:05:21.734678 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6cd10636-4df6-4562-8a22-3c9db8d1d6e0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:21.735234 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6cd10636-4df6-4562-8a22-3c9db8d1d6e0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:21.741812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6cd10636-4df6-4562-8a22-3c9db8d1d6e0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:21.742263 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6cd10636-4df6-4562-8a22-3c9db8d1d6e0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:21.743028 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6cd10636-4df6-4562-8a22-3c9db8d1d6e0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:21.743465 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6cd10636-4df6-4562-8a22-3c9db8d1d6e0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:21.884218 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6cd10636-4df6-4562-8a22-3c9db8d1d6e0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:21.891977 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6cd10636-4df6-4562-8a22-3c9db8d1d6e0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1451 microversion: 2.1 time: 0.161537 Jun 02 14:05:21.892610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 513/1002] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:21 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:22.743298 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a8a5c4ac-a088-4901-8d5d-17fa2b0b2701 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:22.743988 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a8a5c4ac-a088-4901-8d5d-17fa2b0b2701 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:22.750614 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8a5c4ac-a088-4901-8d5d-17fa2b0b2701 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:22.751070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8a5c4ac-a088-4901-8d5d-17fa2b0b2701 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:22.751845 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8a5c4ac-a088-4901-8d5d-17fa2b0b2701 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:22.752334 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8a5c4ac-a088-4901-8d5d-17fa2b0b2701 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:23.008462 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a8a5c4ac-a088-4901-8d5d-17fa2b0b2701 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:23.016449 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a8a5c4ac-a088-4901-8d5d-17fa2b0b2701 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:23.018976 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a8a5c4ac-a088-4901-8d5d-17fa2b0b2701 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:23.019209 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a8a5c4ac-a088-4901-8d5d-17fa2b0b2701 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1731 microversion: 2.20 time: 0.280298 Jun 02 14:05:23.020038 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 490/1003] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:05:22 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1731 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:05:24.039067 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b43cfcd8-db40-49aa-a464-811e93c278a0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:24.040239 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b43cfcd8-db40-49aa-a464-811e93c278a0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:24.057774 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b43cfcd8-db40-49aa-a464-811e93c278a0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:24.058338 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b43cfcd8-db40-49aa-a464-811e93c278a0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:24.059132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b43cfcd8-db40-49aa-a464-811e93c278a0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:24.059567 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b43cfcd8-db40-49aa-a464-811e93c278a0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:24.287883 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b43cfcd8-db40-49aa-a464-811e93c278a0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:24.293656 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b43cfcd8-db40-49aa-a464-811e93c278a0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:24.295162 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b43cfcd8-db40-49aa-a464-811e93c278a0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:24.298193 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b43cfcd8-db40-49aa-a464-811e93c278a0 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1731 microversion: 2.20 time: 0.264511 Jun 02 14:05:24.310774 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 514/1004] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:05:24 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1731 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:05:24.489353 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-2b7e09c2-7ee4-4ff6-9dba-4e66f0d0ad10 req-1e19825a-5a32-462b-9186-e93dc7ab9383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53c5aefc-4310-48eb-87c7-de7e8846e33a", "tag": "cf30a33b-364e-4150-81f4-9ce2821f6b5d"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:05:24.497649 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-2b7e09c2-7ee4-4ff6-9dba-4e66f0d0ad10 req-1e19825a-5a32-462b-9186-e93dc7ab9383 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:24.498336 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-2b7e09c2-7ee4-4ff6-9dba-4e66f0d0ad10 req-1e19825a-5a32-462b-9186-e93dc7ab9383 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:24.510219 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-2b7e09c2-7ee4-4ff6-9dba-4e66f0d0ad10 req-1e19825a-5a32-462b-9186-e93dc7ab9383 service nova] Creating event network-changed:cf30a33b-364e-4150-81f4-9ce2821f6b5d for instance 53c5aefc-4310-48eb-87c7-de7e8846e33a on hv-cinder-82651 Jun 02 14:05:24.515061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-2b7e09c2-7ee4-4ff6-9dba-4e66f0d0ad10 req-1e19825a-5a32-462b-9186-e93dc7ab9383 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088502 Jun 02 14:05:24.515667 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 491/1005] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:05:25.319086 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-869e5911-a554-4405-86a1-41cf4699ece1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:25.319703 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-869e5911-a554-4405-86a1-41cf4699ece1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:25.326739 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-869e5911-a554-4405-86a1-41cf4699ece1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:25.327192 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-869e5911-a554-4405-86a1-41cf4699ece1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:25.328048 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-869e5911-a554-4405-86a1-41cf4699ece1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:25.328390 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-869e5911-a554-4405-86a1-41cf4699ece1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:25.493818 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-869e5911-a554-4405-86a1-41cf4699ece1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:25.502464 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-869e5911-a554-4405-86a1-41cf4699ece1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:25.503971 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-869e5911-a554-4405-86a1-41cf4699ece1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:25.505162 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-869e5911-a554-4405-86a1-41cf4699ece1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1718 microversion: 2.20 time: 0.190778 Jun 02 14:05:25.507557 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 515/1006] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:05:25 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1718 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:05:27.610660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-56d7be3d-78f3-4dab-ad32-e90cbf02617a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:05:27.617995 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-56d7be3d-78f3-4dab-ad32-e90cbf02617a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:27.618437 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-56d7be3d-78f3-4dab-ad32-e90cbf02617a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:27.681999 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-56d7be3d-78f3-4dab-ad32-e90cbf02617a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Going to try to stop instance {{(pid=118315) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 02 14:05:27.895523 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-56d7be3d-78f3-4dab-ad32-e90cbf02617a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "POST /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/action" status: 202 len: 0 microversion: 2.1 time: 0.289163 Jun 02 14:05:27.895955 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 492/1007] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 2 14:05:27 2022] POST /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:05:27.904811 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-51cf8720-b97c-46ba-ac00-d00082030782 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:27.907191 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-51cf8720-b97c-46ba-ac00-d00082030782 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:27.911746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-51cf8720-b97c-46ba-ac00-d00082030782 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:27.912197 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-51cf8720-b97c-46ba-ac00-d00082030782 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:27.914170 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-51cf8720-b97c-46ba-ac00-d00082030782 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:27.914609 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-51cf8720-b97c-46ba-ac00-d00082030782 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:28.049220 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-51cf8720-b97c-46ba-ac00-d00082030782 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:28.057243 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-51cf8720-b97c-46ba-ac00-d00082030782 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1724 microversion: 2.1 time: 0.156355 Jun 02 14:05:28.057802 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 516/1008] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:27 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:29.076445 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c237c86b-83c7-4f99-aad4-1dd95bef809b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:29.077143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c237c86b-83c7-4f99-aad4-1dd95bef809b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:29.083283 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c237c86b-83c7-4f99-aad4-1dd95bef809b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:29.083722 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c237c86b-83c7-4f99-aad4-1dd95bef809b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:29.084563 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c237c86b-83c7-4f99-aad4-1dd95bef809b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:29.085076 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c237c86b-83c7-4f99-aad4-1dd95bef809b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:29.212746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c237c86b-83c7-4f99-aad4-1dd95bef809b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:29.220570 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c237c86b-83c7-4f99-aad4-1dd95bef809b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1724 microversion: 2.1 time: 0.149092 Jun 02 14:05:29.221129 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 493/1009] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:29 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:30.238343 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d4889c55-4860-418a-82f1-3bb031297114 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:30.238947 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d4889c55-4860-418a-82f1-3bb031297114 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:30.246249 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d4889c55-4860-418a-82f1-3bb031297114 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:30.246687 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d4889c55-4860-418a-82f1-3bb031297114 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:30.247426 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d4889c55-4860-418a-82f1-3bb031297114 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:30.247852 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d4889c55-4860-418a-82f1-3bb031297114 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:30.377097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d4889c55-4860-418a-82f1-3bb031297114 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:30.385661 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d4889c55-4860-418a-82f1-3bb031297114 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1724 microversion: 2.1 time: 0.151148 Jun 02 14:05:30.386212 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 517/1010] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:30 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:31.403260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3a4d7945-923d-4a87-a142-0d75f8278eb1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:31.403801 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3a4d7945-923d-4a87-a142-0d75f8278eb1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:31.410341 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3a4d7945-923d-4a87-a142-0d75f8278eb1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:31.410791 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3a4d7945-923d-4a87-a142-0d75f8278eb1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:31.411545 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3a4d7945-923d-4a87-a142-0d75f8278eb1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:31.411975 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3a4d7945-923d-4a87-a142-0d75f8278eb1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:31.545403 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3a4d7945-923d-4a87-a142-0d75f8278eb1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:31.553345 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3a4d7945-923d-4a87-a142-0d75f8278eb1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1724 microversion: 2.1 time: 0.154086 Jun 02 14:05:31.553923 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 494/1011] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:31 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:32.570732 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c826a879-fb64-489d-b61b-0bc2b9d9eef6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:32.571380 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c826a879-fb64-489d-b61b-0bc2b9d9eef6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:32.577893 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c826a879-fb64-489d-b61b-0bc2b9d9eef6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:32.578341 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c826a879-fb64-489d-b61b-0bc2b9d9eef6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:32.579156 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c826a879-fb64-489d-b61b-0bc2b9d9eef6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:32.579588 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c826a879-fb64-489d-b61b-0bc2b9d9eef6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:32.708961 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c826a879-fb64-489d-b61b-0bc2b9d9eef6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:32.717667 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c826a879-fb64-489d-b61b-0bc2b9d9eef6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1724 microversion: 2.1 time: 0.151157 Jun 02 14:05:32.718245 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 518/1012] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:32 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:33.735028 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a8a30959-6cdc-464c-ad5e-b1ebb2ac2a30 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:33.735648 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a8a30959-6cdc-464c-ad5e-b1ebb2ac2a30 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:33.742511 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8a30959-6cdc-464c-ad5e-b1ebb2ac2a30 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:33.742959 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8a30959-6cdc-464c-ad5e-b1ebb2ac2a30 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:33.743716 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8a30959-6cdc-464c-ad5e-b1ebb2ac2a30 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:33.744158 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8a30959-6cdc-464c-ad5e-b1ebb2ac2a30 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:33.877008 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a8a30959-6cdc-464c-ad5e-b1ebb2ac2a30 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:33.885822 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a8a30959-6cdc-464c-ad5e-b1ebb2ac2a30 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1724 microversion: 2.1 time: 0.154696 Jun 02 14:05:33.886381 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 495/1013] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:33 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:34.903568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8ae3bf77-963b-47f7-890f-512abd8fe9e8 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:34.904189 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8ae3bf77-963b-47f7-890f-512abd8fe9e8 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:34.910881 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8ae3bf77-963b-47f7-890f-512abd8fe9e8 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:34.911334 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8ae3bf77-963b-47f7-890f-512abd8fe9e8 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:34.912108 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8ae3bf77-963b-47f7-890f-512abd8fe9e8 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:34.913054 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8ae3bf77-963b-47f7-890f-512abd8fe9e8 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:35.051564 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8ae3bf77-963b-47f7-890f-512abd8fe9e8 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:35.059568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8ae3bf77-963b-47f7-890f-512abd8fe9e8 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1724 microversion: 2.1 time: 0.159971 Jun 02 14:05:35.060140 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 519/1014] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:34 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:36.046820 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-9ba9dbbd-345d-4977-bb96-8c68a498e576 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5afcebe3-d510-4c2b-a2bd-ecaced2eea66"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:05:36.047967 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-9ba9dbbd-345d-4977-bb96-8c68a498e576 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:36.055077 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9ba9dbbd-345d-4977-bb96-8c68a498e576 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:36.055521 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9ba9dbbd-345d-4977-bb96-8c68a498e576 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:36.056283 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9ba9dbbd-345d-4977-bb96-8c68a498e576 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:36.056749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9ba9dbbd-345d-4977-bb96-8c68a498e576 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:36.075931 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e1acbb88-3d28-4f37-9f32-2ebce5966006 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:36.076579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e1acbb88-3d28-4f37-9f32-2ebce5966006 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:36.083018 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e1acbb88-3d28-4f37-9f32-2ebce5966006 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:36.083470 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e1acbb88-3d28-4f37-9f32-2ebce5966006 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:36.084236 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e1acbb88-3d28-4f37-9f32-2ebce5966006 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:36.084700 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e1acbb88-3d28-4f37-9f32-2ebce5966006 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:36.135721 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-9ba9dbbd-345d-4977-bb96-8c68a498e576 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] HTTP exception thrown: Invalid volume: volume 5afcebe3-d510-4c2b-a2bd-ecaced2eea66 is already attached to instances: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-9ba9dbbd-345d-4977-bb96-8c68a498e576 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Request method failure captured: Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: POST /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-volume_attachments HTTP/1.1 Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 74 Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMFy_PkjCh8nju-jA0VaYoRe27Sdij_PJ-vL-9HGf9m-cRULoAY2MzvH3r9nOTiF2_SNa0DGTaap7M-J4JHAJNrDHS-wszymM6zEqEWgK8stKwPY-XOb5tLiYFnXd51Ue2ODNQOEzPNwMcb1Mm2IHy1m8FAhNZxug520YoLsr6cRsBI Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:05:36.137479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:05:36.138961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f72940f7df74b898595c0ed9c654502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:05:36.138961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:05:36.138961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:05:36.138961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:05:36.138961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:05:36.138961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:05:36.138961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:05:36.138961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: b8d05eeb8ac146969b99d33084f1664c Jun 02 14:05:36.138961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:05:36.138961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Jun 02 14:05:36.138961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {"volumeAttachment": {"volumeId": "5afcebe3-d510-4c2b-a2bd-ecaced2eea66"}} Jun 02 14:05:36.138961 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Invalid volume: volume 5afcebe3-d510-4c2b-a2bd-ecaced2eea66 is already attached to instances: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'server_id': 'a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6', 'body': {'volumeAttachment': {'volumeId': '5afcebe3-d510-4c2b-a2bd-ecaced2eea66'}}} Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5afcebe3-d510-4c2b-a2bd-ecaced2eea66 is already attached to instances: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:05:36.139799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5afcebe3-d510-4c2b-a2bd-ecaced2eea66 is already attached to instances: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:05:36.141133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:05:36.142412 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:05:36.142412 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:05:36.142412 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:05:36.142412 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5afcebe3-d510-4c2b-a2bd-ecaced2eea66 is already attached to instances: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 Jun 02 14:05:36.142412 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:05:36.142412 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-9ba9dbbd-345d-4977-bb96-8c68a498e576 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Returning 400 to user: Invalid volume: volume 5afcebe3-d510-4c2b-a2bd-ecaced2eea66 is already attached to instances: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:05:36.142412 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-9ba9dbbd-345d-4977-bb96-8c68a498e576 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "POST /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096164 Jun 02 14:05:36.142412 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 496/1015] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 2 14:05:36 2022] POST /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 14:05:36.204162 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ca2558a4-c2bf-40d3-be50-ae6675ba32d5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:36.204692 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ca2558a4-c2bf-40d3-be50-ae6675ba32d5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:36.211866 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ca2558a4-c2bf-40d3-be50-ae6675ba32d5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:36.212306 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ca2558a4-c2bf-40d3-be50-ae6675ba32d5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:36.213086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ca2558a4-c2bf-40d3-be50-ae6675ba32d5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:36.213516 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ca2558a4-c2bf-40d3-be50-ae6675ba32d5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:36.223753 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e1acbb88-3d28-4f37-9f32-2ebce5966006 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:36.232339 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e1acbb88-3d28-4f37-9f32-2ebce5966006 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1724 microversion: 2.1 time: 0.160235 Jun 02 14:05:36.232938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 520/1016] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:36 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:05:36.293012 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-ca2558a4-c2bf-40d3-be50-ae6675ba32d5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lazy-loading 'services' on Instance uuid a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:05:36.520544 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ca2558a4-c2bf-40d3-be50-ae6675ba32d5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-volume_attachments/5afcebe3-d510-4c2b-a2bd-ecaced2eea66" status: 202 len: 0 microversion: 2.1 time: 0.320078 Jun 02 14:05:36.521143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 497/1017] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 2 14:05:36 2022] DELETE /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-volume_attachments/5afcebe3-d510-4c2b-a2bd-ecaced2eea66 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 14:05:36.530510 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d6357501-0e4a-4a57-816d-97d7bb7b2ed2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:36.531575 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d6357501-0e4a-4a57-816d-97d7bb7b2ed2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:36.537640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6357501-0e4a-4a57-816d-97d7bb7b2ed2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:36.540760 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6357501-0e4a-4a57-816d-97d7bb7b2ed2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:36.540760 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6357501-0e4a-4a57-816d-97d7bb7b2ed2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:36.540760 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6357501-0e4a-4a57-816d-97d7bb7b2ed2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:36.575774 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d6357501-0e4a-4a57-816d-97d7bb7b2ed2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049294 Jun 02 14:05:36.576540 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 521/1018] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:05:36 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:05:37.251928 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-45e6aee6-8f29-4238-8d61-1dc5d0e47a27 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:37.252598 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-45e6aee6-8f29-4238-8d61-1dc5d0e47a27 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:37.260377 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-45e6aee6-8f29-4238-8d61-1dc5d0e47a27 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:37.260862 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-45e6aee6-8f29-4238-8d61-1dc5d0e47a27 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:37.261909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-45e6aee6-8f29-4238-8d61-1dc5d0e47a27 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:37.262348 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-45e6aee6-8f29-4238-8d61-1dc5d0e47a27 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:37.392254 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-45e6aee6-8f29-4238-8d61-1dc5d0e47a27 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:37.401278 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-45e6aee6-8f29-4238-8d61-1dc5d0e47a27 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1724 microversion: 2.1 time: 0.155425 Jun 02 14:05:37.401922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 498/1019] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:37 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:37.587788 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7c3a5e01-3071-43e1-b951-5b15803b98f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:37.588694 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7c3a5e01-3071-43e1-b951-5b15803b98f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:37.595069 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7c3a5e01-3071-43e1-b951-5b15803b98f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:37.595515 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7c3a5e01-3071-43e1-b951-5b15803b98f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:37.596265 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7c3a5e01-3071-43e1-b951-5b15803b98f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:37.596723 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7c3a5e01-3071-43e1-b951-5b15803b98f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:37.625957 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7c3a5e01-3071-43e1-b951-5b15803b98f2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042178 Jun 02 14:05:37.626516 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 522/1020] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:05:37 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:05:38.419150 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f779a266-ec93-4e9e-b855-a9e2f2bea888 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:38.419695 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f779a266-ec93-4e9e-b855-a9e2f2bea888 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:38.426178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f779a266-ec93-4e9e-b855-a9e2f2bea888 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:38.426623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f779a266-ec93-4e9e-b855-a9e2f2bea888 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:38.427375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f779a266-ec93-4e9e-b855-a9e2f2bea888 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:38.427800 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f779a266-ec93-4e9e-b855-a9e2f2bea888 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:38.559954 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f779a266-ec93-4e9e-b855-a9e2f2bea888 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:38.567857 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f779a266-ec93-4e9e-b855-a9e2f2bea888 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1724 microversion: 2.1 time: 0.152680 Jun 02 14:05:38.568423 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 499/1021] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:38 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:38.638027 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e9684ed9-c945-47cc-a4ad-be235163870e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:38.638943 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e9684ed9-c945-47cc-a4ad-be235163870e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:38.645350 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e9684ed9-c945-47cc-a4ad-be235163870e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:38.645795 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e9684ed9-c945-47cc-a4ad-be235163870e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:38.646533 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e9684ed9-c945-47cc-a4ad-be235163870e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:38.646986 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e9684ed9-c945-47cc-a4ad-be235163870e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:38.674525 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e9684ed9-c945-47cc-a4ad-be235163870e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040319 Jun 02 14:05:38.674999 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 523/1022] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:05:38 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 14:05:38.731218 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b85fa642-77c6-4c87-8f93-e205d24c6c30 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:38.731713 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b85fa642-77c6-4c87-8f93-e205d24c6c30 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:38.737811 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b85fa642-77c6-4c87-8f93-e205d24c6c30 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:38.738260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b85fa642-77c6-4c87-8f93-e205d24c6c30 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:38.739020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b85fa642-77c6-4c87-8f93-e205d24c6c30 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:38.739456 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b85fa642-77c6-4c87-8f93-e205d24c6c30 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:38.764872 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b85fa642-77c6-4c87-8f93-e205d24c6c30 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Going to try to terminate instance {{(pid=118315) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:05:38.773162 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:39.066336 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b85fa642-77c6-4c87-8f93-e205d24c6c30 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 204 len: 0 microversion: 2.1 time: 0.338660 Jun 02 14:05:39.066948 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 500/1023] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:05:38 2022] DELETE /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:05:39.075737 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-05ccdeaf-62f6-4c03-855c-d4e0440221e5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:39.076324 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-05ccdeaf-62f6-4c03-855c-d4e0440221e5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:39.082635 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-05ccdeaf-62f6-4c03-855c-d4e0440221e5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:39.083081 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-05ccdeaf-62f6-4c03-855c-d4e0440221e5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:39.083840 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-05ccdeaf-62f6-4c03-855c-d4e0440221e5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:39.084269 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-05ccdeaf-62f6-4c03-855c-d4e0440221e5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:39.089177 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:39.228916 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-05ccdeaf-62f6-4c03-855c-d4e0440221e5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:39.236133 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-05ccdeaf-62f6-4c03-855c-d4e0440221e5 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1681 microversion: 2.1 time: 0.164448 Jun 02 14:05:39.236732 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 524/1024] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:39 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:39.588255 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f4a4e805-2afd-4635-a0cd-c53806e44695 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:39.588995 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f4a4e805-2afd-4635-a0cd-c53806e44695 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:39.595423 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f4a4e805-2afd-4635-a0cd-c53806e44695 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:39.595873 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f4a4e805-2afd-4635-a0cd-c53806e44695 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:39.596674 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f4a4e805-2afd-4635-a0cd-c53806e44695 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:39.597110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f4a4e805-2afd-4635-a0cd-c53806e44695 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:39.725186 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f4a4e805-2afd-4635-a0cd-c53806e44695 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:39.733199 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f4a4e805-2afd-4635-a0cd-c53806e44695 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1724 microversion: 2.1 time: 0.150902 Jun 02 14:05:39.733764 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 501/1025] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:39 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:40.252899 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9bd2ee43-6944-4276-91a8-ce5e4cf5c91c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:40.253519 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9bd2ee43-6944-4276-91a8-ce5e4cf5c91c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:40.261134 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9bd2ee43-6944-4276-91a8-ce5e4cf5c91c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:40.261579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9bd2ee43-6944-4276-91a8-ce5e4cf5c91c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:40.262336 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9bd2ee43-6944-4276-91a8-ce5e4cf5c91c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:40.262769 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9bd2ee43-6944-4276-91a8-ce5e4cf5c91c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:40.392713 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9bd2ee43-6944-4276-91a8-ce5e4cf5c91c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:40.400391 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9bd2ee43-6944-4276-91a8-ce5e4cf5c91c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1681 microversion: 2.1 time: 0.151351 Jun 02 14:05:40.400979 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 525/1026] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:40 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:40.752009 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-99ecbe84-ecce-406a-868f-f0539b073fee tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:40.752655 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-99ecbe84-ecce-406a-868f-f0539b073fee tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:40.759982 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-99ecbe84-ecce-406a-868f-f0539b073fee tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:40.760470 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-99ecbe84-ecce-406a-868f-f0539b073fee tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:40.761293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-99ecbe84-ecce-406a-868f-f0539b073fee tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:40.761789 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-99ecbe84-ecce-406a-868f-f0539b073fee tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:40.911349 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-99ecbe84-ecce-406a-868f-f0539b073fee tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:40.919960 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-99ecbe84-ecce-406a-868f-f0539b073fee tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1724 microversion: 2.1 time: 0.172248 Jun 02 14:05:40.920532 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 502/1027] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:40 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:41.418845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-44de3906-6f31-4654-a9c2-adc0605c0aa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:41.419642 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-44de3906-6f31-4654-a9c2-adc0605c0aa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:41.427083 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44de3906-6f31-4654-a9c2-adc0605c0aa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:41.427598 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44de3906-6f31-4654-a9c2-adc0605c0aa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:41.428653 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44de3906-6f31-4654-a9c2-adc0605c0aa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:41.429648 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44de3906-6f31-4654-a9c2-adc0605c0aa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:41.578962 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-44de3906-6f31-4654-a9c2-adc0605c0aa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:41.578962 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-44de3906-6f31-4654-a9c2-adc0605c0aa6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1681 microversion: 2.1 time: 0.162665 Jun 02 14:05:41.578962 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 526/1028] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:41 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:05:41.937174 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f440e9e8-5142-4b51-8f66-a9cc0f939670 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:41.937744 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f440e9e8-5142-4b51-8f66-a9cc0f939670 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:41.944207 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f440e9e8-5142-4b51-8f66-a9cc0f939670 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:41.945059 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f440e9e8-5142-4b51-8f66-a9cc0f939670 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:41.945821 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f440e9e8-5142-4b51-8f66-a9cc0f939670 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:41.946253 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f440e9e8-5142-4b51-8f66-a9cc0f939670 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:42.079024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f440e9e8-5142-4b51-8f66-a9cc0f939670 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:42.087210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f440e9e8-5142-4b51-8f66-a9cc0f939670 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1724 microversion: 2.1 time: 0.154109 Jun 02 14:05:42.089572 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 503/1029] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:41 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:42.590010 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-32b20dea-efea-4299-b232-b4580c029566 req-997054da-e8dd-4e6a-a827-1490a69fdd7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6", "name": "network-vif-deleted", "tag": "e0162a80-31b2-4445-aa2c-973d6d0f416a"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:05:42.594556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f241300b-3241-43eb-9ee0-f76a750f7d7a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:42.595609 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f241300b-3241-43eb-9ee0-f76a750f7d7a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:42.598661 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-32b20dea-efea-4299-b232-b4580c029566 req-997054da-e8dd-4e6a-a827-1490a69fdd7d service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:42.599116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-32b20dea-efea-4299-b232-b4580c029566 req-997054da-e8dd-4e6a-a827-1490a69fdd7d service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:42.603007 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f241300b-3241-43eb-9ee0-f76a750f7d7a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:42.603461 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f241300b-3241-43eb-9ee0-f76a750f7d7a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:42.604443 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f241300b-3241-43eb-9ee0-f76a750f7d7a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:42.604860 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f241300b-3241-43eb-9ee0-f76a750f7d7a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:42.619480 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-32b20dea-efea-4299-b232-b4580c029566 req-997054da-e8dd-4e6a-a827-1490a69fdd7d service nova] Creating event network-vif-deleted:e0162a80-31b2-4445-aa2c-973d6d0f416a for instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 on hv-cinder-82651 Jun 02 14:05:42.625307 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-32b20dea-efea-4299-b232-b4580c029566 req-997054da-e8dd-4e6a-a827-1490a69fdd7d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111531 Jun 02 14:05:42.627229 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 527/1030] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:05:42.677241 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f241300b-3241-43eb-9ee0-f76a750f7d7a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:42.685762 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f241300b-3241-43eb-9ee0-f76a750f7d7a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1614 microversion: 2.1 time: 0.095901 Jun 02 14:05:42.697100 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 504/1031] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:42 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:05:43.030749 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:05:43.030749 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Thu Jun 2 14:05:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:05:43.106116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-32a47a71-f06f-4a94-b381-6913885b7884 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:43.106911 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-32a47a71-f06f-4a94-b381-6913885b7884 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:43.113164 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-32a47a71-f06f-4a94-b381-6913885b7884 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:43.113612 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-32a47a71-f06f-4a94-b381-6913885b7884 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:43.114380 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-32a47a71-f06f-4a94-b381-6913885b7884 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:43.114813 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-32a47a71-f06f-4a94-b381-6913885b7884 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:43.254471 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-32a47a71-f06f-4a94-b381-6913885b7884 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:43.262694 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-32a47a71-f06f-4a94-b381-6913885b7884 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1724 microversion: 2.1 time: 0.162167 Jun 02 14:05:43.263251 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 528/1032] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:43 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:43.705466 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-8f07248c-2bcf-48ca-b344-53cb115c446e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:43.706074 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-8f07248c-2bcf-48ca-b344-53cb115c446e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:43.713348 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8f07248c-2bcf-48ca-b344-53cb115c446e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:43.713984 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8f07248c-2bcf-48ca-b344-53cb115c446e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:43.714753 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8f07248c-2bcf-48ca-b344-53cb115c446e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:43.715184 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8f07248c-2bcf-48ca-b344-53cb115c446e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:43.748737 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8f07248c-2bcf-48ca-b344-53cb115c446e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:43.749185 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8f07248c-2bcf-48ca-b344-53cb115c446e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:43.749630 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-8f07248c-2bcf-48ca-b344-53cb115c446e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lazy-loading 'fault' on Instance uuid a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:05:43.790907 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-8f07248c-2bcf-48ca-b344-53cb115c446e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:43.798583 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-8f07248c-2bcf-48ca-b344-53cb115c446e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 200 len: 1331 microversion: 2.1 time: 0.097760 Jun 02 14:05:43.799159 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 505/1033] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:43 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:44.279271 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-26b114d0-bf5f-4d2b-9f7e-21482e537182 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:44.279887 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-26b114d0-bf5f-4d2b-9f7e-21482e537182 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:44.286405 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-26b114d0-bf5f-4d2b-9f7e-21482e537182 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:44.286857 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-26b114d0-bf5f-4d2b-9f7e-21482e537182 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:44.287635 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-26b114d0-bf5f-4d2b-9f7e-21482e537182 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:44.288051 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-26b114d0-bf5f-4d2b-9f7e-21482e537182 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:44.417828 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-26b114d0-bf5f-4d2b-9f7e-21482e537182 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:44.425849 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-26b114d0-bf5f-4d2b-9f7e-21482e537182 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1701 microversion: 2.1 time: 0.150654 Jun 02 14:05:44.426404 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 529/1034] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:44 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1701 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:44.443040 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b6ed9669-ba66-407c-af88-8c3c72335edc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:05:44.449792 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b6ed9669-ba66-407c-af88-8c3c72335edc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:44.450247 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b6ed9669-ba66-407c-af88-8c3c72335edc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:44.472344 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b6ed9669-ba66-407c-af88-8c3c72335edc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Going to try to start instance {{(pid=118315) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 02 14:05:44.678041 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b6ed9669-ba66-407c-af88-8c3c72335edc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "POST /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/action" status: 202 len: 0 microversion: 2.1 time: 0.238718 Jun 02 14:05:44.678652 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 506/1035] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 2 14:05:44 2022] POST /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 14:05:44.686654 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-862584ae-7867-45c6-b038-19bd494e4de5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:44.687274 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-862584ae-7867-45c6-b038-19bd494e4de5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:44.693219 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-862584ae-7867-45c6-b038-19bd494e4de5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:44.693671 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-862584ae-7867-45c6-b038-19bd494e4de5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:44.694436 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-862584ae-7867-45c6-b038-19bd494e4de5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:44.695411 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-862584ae-7867-45c6-b038-19bd494e4de5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:44.818750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c28ee559-1cee-4209-836b-fc1721873dd3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:44.820545 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c28ee559-1cee-4209-836b-fc1721873dd3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:44.835839 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-862584ae-7867-45c6-b038-19bd494e4de5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:44.836636 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c28ee559-1cee-4209-836b-fc1721873dd3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:44.837125 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c28ee559-1cee-4209-836b-fc1721873dd3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:44.837941 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c28ee559-1cee-4209-836b-fc1721873dd3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:44.838537 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c28ee559-1cee-4209-836b-fc1721873dd3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:44.842494 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-862584ae-7867-45c6-b038-19bd494e4de5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1710 microversion: 2.1 time: 0.159594 Jun 02 14:05:44.843072 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 530/1036] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:44 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:44.855332 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-c28ee559-1cee-4209-836b-fc1721873dd3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] HTTP exception thrown: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c28ee559-1cee-4209-836b-fc1721873dd3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Request method failure captured: Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 HTTP/1.1 Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMFy_PkjCh8nju-jA0VaYoRe27Sdij_PJ-vL-9HGf9m-cRULoAY2MzvH3r9nOTiF2_SNa0DGTaap7M-J4JHAJNrDHS-wszymM6zEqEWgK8stKwPY-XOb5tLiYFnXd51Ue2ODNQOEzPNwMcb1Mm2IHy1m8FAhNZxug520YoLsr6cRsBI Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:05:44.857292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:05:44.858994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f72940f7df74b898595c0ed9c654502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:05:44.858994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:05:44.858994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:05:44.858994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:05:44.858994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:05:44.858994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:05:44.858994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:05:44.858994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: b8d05eeb8ac146969b99d33084f1664c Jun 02 14:05:44.858994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:05:44.858994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:05:44.858994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:05:44.858994 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': 'a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6'} Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:05:44.859922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:05:44.861292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:05:44.862471 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c28ee559-1cee-4209-836b-fc1721873dd3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Returning 404 to user: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:05:44.862471 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c28ee559-1cee-4209-836b-fc1721873dd3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 404 len: 111 microversion: 2.1 time: 0.045435 Jun 02 14:05:44.862471 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 507/1037] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:44 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:05:44.868678 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-225b932a-ab2b-4758-b3b3-a3f24a26f6c4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '.version_select at 0x7fb71ac91c10>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:44.936246 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-225b932a-ab2b-4758-b3b3-a3f24a26f6c4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145678587" status: 202 len: 0 microversion: 2.1 time: 0.071443 Jun 02 14:05:44.936889 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 531/1038] 10.222.0.33 () {58 vars in 1220 bytes} [Thu Jun 2 14:05:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145678587 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:05:45.672809 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-6020c73a-d0a1-44b6-a876-3895b4e9535b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Action: 'create', calling method: .version_select at 0x7fb71af61dc0>, body: {"keypair": {"name": "tempest-keypair-394136858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzczp3g7PCrBdFmasHVM7DhICCqQ0z/sBQTwaPBGJNWOysnlsNh9gPABkSgE1th/fUNGDQ3ErbnhCw1CTrUV0pus8Dxg6U3NLYb+zTmUnbPMJySoP+Nw/2B6NL9FXr7MQ=="}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:05:45.687264 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-6020c73a-d0a1-44b6-a876-3895b4e9535b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for project 8f72940f7df74b898595c0ed9c654502. Resources: {'key_pairs'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:05:45.691073 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.quota [None req-6020c73a-d0a1-44b6-a876-3895b4e9535b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for user b8d05eeb8ac146969b99d33084f1664c and project 8f72940f7df74b898595c0ed9c654502. Resources: {'key_pairs'} {{(pid=118315) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:05:45.779065 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-6020c73a-d0a1-44b6-a876-3895b4e9535b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110098 Jun 02 14:05:45.779591 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 508/1039] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 2 14:05:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:05:45.859663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c757dbf8-0a04-4cda-ba2d-5eef8f94f61f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:45.860259 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c757dbf8-0a04-4cda-ba2d-5eef8f94f61f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:45.866841 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c757dbf8-0a04-4cda-ba2d-5eef8f94f61f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:45.867358 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c757dbf8-0a04-4cda-ba2d-5eef8f94f61f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:45.868813 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c757dbf8-0a04-4cda-ba2d-5eef8f94f61f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:45.869261 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c757dbf8-0a04-4cda-ba2d-5eef8f94f61f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:46.024941 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c757dbf8-0a04-4cda-ba2d-5eef8f94f61f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:46.032913 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c757dbf8-0a04-4cda-ba2d-5eef8f94f61f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1710 microversion: 2.1 time: 0.177687 Jun 02 14:05:46.033418 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 532/1040] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:45 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1710 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:47.051226 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1db97050-a001-4f09-b060-fd0fe612a40a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:47.051844 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1db97050-a001-4f09-b060-fd0fe612a40a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:47.058849 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1db97050-a001-4f09-b060-fd0fe612a40a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:47.059285 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1db97050-a001-4f09-b060-fd0fe612a40a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:47.060055 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1db97050-a001-4f09-b060-fd0fe612a40a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:47.060521 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1db97050-a001-4f09-b060-fd0fe612a40a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:47.281558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1db97050-a001-4f09-b060-fd0fe612a40a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:47.290581 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1db97050-a001-4f09-b060-fd0fe612a40a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1714 microversion: 2.1 time: 0.243835 Jun 02 14:05:47.291168 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 509/1041] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:47 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1714 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:48.323870 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-830880439", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14cc21cb-4d69-474d-9628-4e979c4e6581"}], "security_groups": [{"name": "tempest-securitygroup--1966051742"}], "key_name": "tempest-keypair-394136858", "user_data": "}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:05:48.425350 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.network.neutron [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] validate_networks() for [('14cc21cb-4d69-474d-9628-4e979c4e6581', None, None, None, None, None)] {{(pid=118316) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 14:05:48.796449 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Flavor limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 14:05:48.796895 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Image limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 14:05:48.797358 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Flavor pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 14:05:48.797781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Image pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 14:05:48.798176 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 14:05:48.800066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:48.807585 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:48.808040 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:48.808856 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:48.809281 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:48.826391 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for project 8f72940f7df74b898595c0ed9c654502. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:05:48.830258 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Getting quotas for user b8d05eeb8ac146969b99d33084f1664c and project 8f72940f7df74b898595c0ed9c654502. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:05:48.841817 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Going to run 1 instances... {{(pid=118316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 14:05:48.844037 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 14:05:49.031323 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8e4fb692-8dfc-4ec7-9255-9c9a2ecc16bc tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.712018 Jun 02 14:05:49.031972 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 533/1042] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 14:05:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 14:05:49.042079 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2d92538c-eff9-4226-8685-8ec028b12998 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:49.042731 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-2d92538c-eff9-4226-8685-8ec028b12998 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:49.045326 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:49.101211 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2d92538c-eff9-4226-8685-8ec028b12998 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:49.109103 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2d92538c-eff9-4226-8685-8ec028b12998 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1240 microversion: 2.1 time: 0.071107 Jun 02 14:05:49.109792 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 510/1043] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:49 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:50.127167 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6d697772-3c28-4279-a685-0320380803b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:50.127777 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6d697772-3c28-4279-a685-0320380803b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:50.134551 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6d697772-3c28-4279-a685-0320380803b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:50.134994 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6d697772-3c28-4279-a685-0320380803b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:50.135738 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6d697772-3c28-4279-a685-0320380803b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:50.136177 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6d697772-3c28-4279-a685-0320380803b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:50.197496 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6d697772-3c28-4279-a685-0320380803b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:50.205038 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6d697772-3c28-4279-a685-0320380803b6 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1244 microversion: 2.1 time: 0.082335 Jun 02 14:05:50.205617 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 534/1044] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:50 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:51.222933 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-8afa97b9-be76-49f2-9cb5-c08123ce1660 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:51.223493 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-8afa97b9-be76-49f2-9cb5-c08123ce1660 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:51.231944 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8afa97b9-be76-49f2-9cb5-c08123ce1660 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:51.238108 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8afa97b9-be76-49f2-9cb5-c08123ce1660 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:51.238108 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8afa97b9-be76-49f2-9cb5-c08123ce1660 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:51.238108 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8afa97b9-be76-49f2-9cb5-c08123ce1660 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:51.295503 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-8afa97b9-be76-49f2-9cb5-c08123ce1660 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:51.303182 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-8afa97b9-be76-49f2-9cb5-c08123ce1660 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1292 microversion: 2.1 time: 0.084203 Jun 02 14:05:51.304307 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 511/1045] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:51 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:05:52.320554 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d245ce0d-df09-492f-af4b-26e25098e25c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:52.321344 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d245ce0d-df09-492f-af4b-26e25098e25c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:52.327616 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d245ce0d-df09-492f-af4b-26e25098e25c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:52.328056 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d245ce0d-df09-492f-af4b-26e25098e25c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:52.328842 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d245ce0d-df09-492f-af4b-26e25098e25c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:52.329271 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d245ce0d-df09-492f-af4b-26e25098e25c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:52.465803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d245ce0d-df09-492f-af4b-26e25098e25c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:52.473368 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d245ce0d-df09-492f-af4b-26e25098e25c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1366 microversion: 2.1 time: 0.156968 Jun 02 14:05:52.473935 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 535/1046] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:52 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:53.120930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-a539e4fa-99ff-42ce-9505-b9f487b074b8 req-757ebb26-d75d-4389-a4e2-0871eea06e7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902069a0-6b09-40fd-b5b9-23530be90d8a", "tag": "7ffd522e-fd78-4776-9eaa-a163afff7dfe"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:05:53.131505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-a539e4fa-99ff-42ce-9505-b9f487b074b8 req-757ebb26-d75d-4389-a4e2-0871eea06e7f service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:53.132297 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-a539e4fa-99ff-42ce-9505-b9f487b074b8 req-757ebb26-d75d-4389-a4e2-0871eea06e7f service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:53.145448 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-a539e4fa-99ff-42ce-9505-b9f487b074b8 req-757ebb26-d75d-4389-a4e2-0871eea06e7f service nova] Creating event network-changed:7ffd522e-fd78-4776-9eaa-a163afff7dfe for instance 902069a0-6b09-40fd-b5b9-23530be90d8a on hv-cinder-82651 Jun 02 14:05:53.152430 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-a539e4fa-99ff-42ce-9505-b9f487b074b8 req-757ebb26-d75d-4389-a4e2-0871eea06e7f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036406 Jun 02 14:05:53.153166 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 512/1047] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:05:53.490374 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f7c08030-2415-45b0-aa4d-76819c2de5a3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:53.491007 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f7c08030-2415-45b0-aa4d-76819c2de5a3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:53.497845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f7c08030-2415-45b0-aa4d-76819c2de5a3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:53.498287 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f7c08030-2415-45b0-aa4d-76819c2de5a3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:53.499072 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f7c08030-2415-45b0-aa4d-76819c2de5a3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:53.499499 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f7c08030-2415-45b0-aa4d-76819c2de5a3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:53.632574 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f7c08030-2415-45b0-aa4d-76819c2de5a3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:53.641262 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f7c08030-2415-45b0-aa4d-76819c2de5a3 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1366 microversion: 2.1 time: 0.154790 Jun 02 14:05:53.641847 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 536/1048] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:53 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:54.659912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5a77b6af-eb03-45de-9189-82c0f277d43a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:54.660690 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5a77b6af-eb03-45de-9189-82c0f277d43a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:54.667259 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5a77b6af-eb03-45de-9189-82c0f277d43a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:54.667720 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5a77b6af-eb03-45de-9189-82c0f277d43a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:54.668499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5a77b6af-eb03-45de-9189-82c0f277d43a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:54.668935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5a77b6af-eb03-45de-9189-82c0f277d43a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:54.802842 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5a77b6af-eb03-45de-9189-82c0f277d43a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:54.811115 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5a77b6af-eb03-45de-9189-82c0f277d43a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1366 microversion: 2.1 time: 0.156368 Jun 02 14:05:54.811689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 513/1049] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:54 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:55.828866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e46b4c78-0786-4eef-b888-a2c96503c3c9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:55.829576 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e46b4c78-0786-4eef-b888-a2c96503c3c9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:55.837073 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e46b4c78-0786-4eef-b888-a2c96503c3c9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:55.837521 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e46b4c78-0786-4eef-b888-a2c96503c3c9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:55.838278 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e46b4c78-0786-4eef-b888-a2c96503c3c9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:55.838711 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e46b4c78-0786-4eef-b888-a2c96503c3c9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:55.972455 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e46b4c78-0786-4eef-b888-a2c96503c3c9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:55.980767 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e46b4c78-0786-4eef-b888-a2c96503c3c9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1366 microversion: 2.1 time: 0.155773 Jun 02 14:05:55.981333 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 537/1050] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:55 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:56.997913 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a7901cf9-cd11-4889-8aac-35e45c50cbac tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:56.998531 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a7901cf9-cd11-4889-8aac-35e45c50cbac tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:57.005102 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a7901cf9-cd11-4889-8aac-35e45c50cbac tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:57.005550 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a7901cf9-cd11-4889-8aac-35e45c50cbac tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:57.006312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a7901cf9-cd11-4889-8aac-35e45c50cbac tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:57.006749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a7901cf9-cd11-4889-8aac-35e45c50cbac tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:57.139248 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a7901cf9-cd11-4889-8aac-35e45c50cbac tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:57.146925 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a7901cf9-cd11-4889-8aac-35e45c50cbac tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1366 microversion: 2.1 time: 0.153016 Jun 02 14:05:57.147481 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 514/1051] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:56 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:58.164159 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d9ce9cba-408d-4174-94f0-64e82550e4c4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:58.165510 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d9ce9cba-408d-4174-94f0-64e82550e4c4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:58.172173 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d9ce9cba-408d-4174-94f0-64e82550e4c4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:58.172627 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d9ce9cba-408d-4174-94f0-64e82550e4c4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:58.173867 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d9ce9cba-408d-4174-94f0-64e82550e4c4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:58.174575 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d9ce9cba-408d-4174-94f0-64e82550e4c4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:58.312542 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d9ce9cba-408d-4174-94f0-64e82550e4c4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:58.320135 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d9ce9cba-408d-4174-94f0-64e82550e4c4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1366 microversion: 2.1 time: 0.159809 Jun 02 14:05:58.321284 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 538/1052] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:58 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:05:59.338301 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b98d3a90-a75f-4083-b449-98c471ba37d9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:05:59.338921 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b98d3a90-a75f-4083-b449-98c471ba37d9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:05:59.340995 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=6 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:59.345814 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b98d3a90-a75f-4083-b449-98c471ba37d9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:59.346270 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b98d3a90-a75f-4083-b449-98c471ba37d9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:59.347034 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b98d3a90-a75f-4083-b449-98c471ba37d9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:05:59.347474 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b98d3a90-a75f-4083-b449-98c471ba37d9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:05:59.476903 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b98d3a90-a75f-4083-b449-98c471ba37d9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:05:59.485378 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b98d3a90-a75f-4083-b449-98c471ba37d9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1366 microversion: 2.1 time: 0.151446 Jun 02 14:05:59.485957 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 515/1053] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:05:59 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:06:00.502320 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f547c942-fab7-4914-9be5-5cdf990e5430 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:00.502932 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f547c942-fab7-4914-9be5-5cdf990e5430 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:00.504828 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:00.505469 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=6 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:00.512039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f547c942-fab7-4914-9be5-5cdf990e5430 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:00.512562 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f547c942-fab7-4914-9be5-5cdf990e5430 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:00.513318 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f547c942-fab7-4914-9be5-5cdf990e5430 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:00.513746 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f547c942-fab7-4914-9be5-5cdf990e5430 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:00.648292 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f547c942-fab7-4914-9be5-5cdf990e5430 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:00.656127 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f547c942-fab7-4914-9be5-5cdf990e5430 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1366 microversion: 2.1 time: 0.157796 Jun 02 14:06:00.656727 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 539/1054] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:06:00 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:06:01.674287 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-8839a807-4ef2-4e6a-a783-c24da69602d2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:01.675047 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-8839a807-4ef2-4e6a-a783-c24da69602d2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:01.682475 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8839a807-4ef2-4e6a-a783-c24da69602d2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:01.682925 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8839a807-4ef2-4e6a-a783-c24da69602d2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:01.683692 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8839a807-4ef2-4e6a-a783-c24da69602d2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:01.684125 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8839a807-4ef2-4e6a-a783-c24da69602d2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:01.723188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-99c17623-7fdf-40f0-a227-46bc2b9e8a05 req-cc3905ca-de0f-4438-99db-1dc5ad210aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902069a0-6b09-40fd-b5b9-23530be90d8a", "name": "network-vif-plugged", "status": "completed", "tag": "7ffd522e-fd78-4776-9eaa-a163afff7dfe"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:06:01.732866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-99c17623-7fdf-40f0-a227-46bc2b9e8a05 req-cc3905ca-de0f-4438-99db-1dc5ad210aef service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:01.733330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-99c17623-7fdf-40f0-a227-46bc2b9e8a05 req-cc3905ca-de0f-4438-99db-1dc5ad210aef service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:01.744925 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-99c17623-7fdf-40f0-a227-46bc2b9e8a05 req-cc3905ca-de0f-4438-99db-1dc5ad210aef service nova] Creating event network-vif-plugged:7ffd522e-fd78-4776-9eaa-a163afff7dfe for instance 902069a0-6b09-40fd-b5b9-23530be90d8a on hv-cinder-82651 Jun 02 14:06:01.749934 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-99c17623-7fdf-40f0-a227-46bc2b9e8a05 req-cc3905ca-de0f-4438-99db-1dc5ad210aef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030848 Jun 02 14:06:01.750589 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 540/1055] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:06:01.819832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-8839a807-4ef2-4e6a-a783-c24da69602d2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:01.826018 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-8839a807-4ef2-4e6a-a783-c24da69602d2 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1366 microversion: 2.1 time: 0.155912 Jun 02 14:06:01.826596 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 516/1056] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:06:01 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:06:02.844830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-cb596902-de2b-406b-a6d7-df66839e9e3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:02.845452 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-cb596902-de2b-406b-a6d7-df66839e9e3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:02.851599 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cb596902-de2b-406b-a6d7-df66839e9e3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:02.852040 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cb596902-de2b-406b-a6d7-df66839e9e3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:02.852826 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cb596902-de2b-406b-a6d7-df66839e9e3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:02.853264 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-cb596902-de2b-406b-a6d7-df66839e9e3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:02.990228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-cb596902-de2b-406b-a6d7-df66839e9e3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:02.997845 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-cb596902-de2b-406b-a6d7-df66839e9e3f tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1366 microversion: 2.1 time: 0.157868 Jun 02 14:06:02.998411 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 541/1057] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:06:02 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:06:04.015120 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0abd7aba-ada8-4ee8-bfec-7bdf4077ee0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:04.015722 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0abd7aba-ada8-4ee8-bfec-7bdf4077ee0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:04.022392 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0abd7aba-ada8-4ee8-bfec-7bdf4077ee0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:04.022846 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0abd7aba-ada8-4ee8-bfec-7bdf4077ee0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:04.023611 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0abd7aba-ada8-4ee8-bfec-7bdf4077ee0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:04.024047 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0abd7aba-ada8-4ee8-bfec-7bdf4077ee0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:04.152330 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0abd7aba-ada8-4ee8-bfec-7bdf4077ee0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:04.155804 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:04.160064 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0abd7aba-ada8-4ee8-bfec-7bdf4077ee0c tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1366 microversion: 2.1 time: 0.148916 Jun 02 14:06:04.160689 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 517/1058] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:06:04 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:06:05.177604 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-54340be5-bf58-41f2-884e-3cb26c9d304a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:05.178143 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-54340be5-bf58-41f2-884e-3cb26c9d304a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:05.185052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-54340be5-bf58-41f2-884e-3cb26c9d304a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:05.185501 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-54340be5-bf58-41f2-884e-3cb26c9d304a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:05.186261 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-54340be5-bf58-41f2-884e-3cb26c9d304a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:05.186694 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-54340be5-bf58-41f2-884e-3cb26c9d304a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:05.317467 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-54340be5-bf58-41f2-884e-3cb26c9d304a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:05.325190 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-54340be5-bf58-41f2-884e-3cb26c9d304a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1555 microversion: 2.1 time: 0.151540 Jun 02 14:06:05.325754 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 542/1059] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:06:05 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:06:05.342233 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-835b6c3f-4524-4973-8750-60337bfb3608 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:05.342739 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-835b6c3f-4524-4973-8750-60337bfb3608 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:05.349500 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-835b6c3f-4524-4973-8750-60337bfb3608 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:05.349947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-835b6c3f-4524-4973-8750-60337bfb3608 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:05.350706 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-835b6c3f-4524-4973-8750-60337bfb3608 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:05.351141 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-835b6c3f-4524-4973-8750-60337bfb3608 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:05.431933 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-835b6c3f-4524-4973-8750-60337bfb3608 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093865 Jun 02 14:06:05.432575 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 518/1060] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 2 14:06:05 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:06:06.616237 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-bfbcb3b8-7084-4b36-9225-a5923ca9c213 req-d9a5d6d3-2297-47ec-babf-254281a597f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902069a0-6b09-40fd-b5b9-23530be90d8a", "tag": "7ffd522e-fd78-4776-9eaa-a163afff7dfe"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:06:06.625154 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-bfbcb3b8-7084-4b36-9225-a5923ca9c213 req-d9a5d6d3-2297-47ec-babf-254281a597f6 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:06.625662 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-bfbcb3b8-7084-4b36-9225-a5923ca9c213 req-d9a5d6d3-2297-47ec-babf-254281a597f6 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:06.637694 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-bfbcb3b8-7084-4b36-9225-a5923ca9c213 req-d9a5d6d3-2297-47ec-babf-254281a597f6 service nova] Creating event network-changed:7ffd522e-fd78-4776-9eaa-a163afff7dfe for instance 902069a0-6b09-40fd-b5b9-23530be90d8a on hv-cinder-82651 Jun 02 14:06:06.642963 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-bfbcb3b8-7084-4b36-9225-a5923ca9c213 req-d9a5d6d3-2297-47ec-babf-254281a597f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030397 Jun 02 14:06:06.647886 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 543/1061] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:06:43.328396 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=19 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:43.329174 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=4 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:43.333202 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d3919dff-8393-495d-b731-14abc8601468 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:43.334143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d3919dff-8393-495d-b731-14abc8601468 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:43.339975 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3919dff-8393-495d-b731-14abc8601468 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:43.341662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3919dff-8393-495d-b731-14abc8601468 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:43.341662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3919dff-8393-495d-b731-14abc8601468 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:43.341878 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d3919dff-8393-495d-b731-14abc8601468 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:43.370374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d3919dff-8393-495d-b731-14abc8601468 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043433 Jun 02 14:06:43.376026 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 519/1062] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 2 14:06:43 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:06:43.429603 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6777d6b5-945d-4a8d-92f4-643e747053db tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:43.430179 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6777d6b5-945d-4a8d-92f4-643e747053db tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:43.432275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:43.432967 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=97 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:43.438535 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6777d6b5-945d-4a8d-92f4-643e747053db tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:43.439008 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6777d6b5-945d-4a8d-92f4-643e747053db tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:43.439761 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6777d6b5-945d-4a8d-92f4-643e747053db tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:43.440192 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6777d6b5-945d-4a8d-92f4-643e747053db tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:43.464653 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6777d6b5-945d-4a8d-92f4-643e747053db tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Going to try to terminate instance {{(pid=118316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:06:43.784880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6777d6b5-945d-4a8d-92f4-643e747053db tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "DELETE /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 204 len: 0 microversion: 2.20 time: 0.359226 Jun 02 14:06:43.785503 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 544/1063] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 2 14:06:43 2022] DELETE /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 14:06:43.793839 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1e646d1e-dbc7-4e45-89fe-481c9d921ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:43.796836 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1e646d1e-dbc7-4e45-89fe-481c9d921ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:43.801950 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e646d1e-dbc7-4e45-89fe-481c9d921ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:43.802401 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e646d1e-dbc7-4e45-89fe-481c9d921ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:43.803178 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e646d1e-dbc7-4e45-89fe-481c9d921ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:43.803601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e646d1e-dbc7-4e45-89fe-481c9d921ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:43.935530 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1e646d1e-dbc7-4e45-89fe-481c9d921ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:43.943531 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1e646d1e-dbc7-4e45-89fe-481c9d921ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:43.945358 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1e646d1e-dbc7-4e45-89fe-481c9d921ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:43.946534 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1e646d1e-dbc7-4e45-89fe-481c9d921ce3 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.156617 Jun 02 14:06:43.947090 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 520/1064] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:06:43 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:06:44.966098 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0db280bf-e062-4be3-9de7-32afb8c7dbb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:44.966757 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0db280bf-e062-4be3-9de7-32afb8c7dbb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:44.973260 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0db280bf-e062-4be3-9de7-32afb8c7dbb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:44.973703 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0db280bf-e062-4be3-9de7-32afb8c7dbb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:44.974444 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0db280bf-e062-4be3-9de7-32afb8c7dbb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:44.974869 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0db280bf-e062-4be3-9de7-32afb8c7dbb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:45.105255 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0db280bf-e062-4be3-9de7-32afb8c7dbb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:45.115957 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0db280bf-e062-4be3-9de7-32afb8c7dbb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:45.117486 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0db280bf-e062-4be3-9de7-32afb8c7dbb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:45.118637 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0db280bf-e062-4be3-9de7-32afb8c7dbb1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.156902 Jun 02 14:06:45.119196 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 545/1065] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:06:44 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:06:46.139868 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e908267c-314f-4f8f-95bb-355c1039c624 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:46.140479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e908267c-314f-4f8f-95bb-355c1039c624 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:46.146980 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e908267c-314f-4f8f-95bb-355c1039c624 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:46.147369 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e908267c-314f-4f8f-95bb-355c1039c624 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:46.148161 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e908267c-314f-4f8f-95bb-355c1039c624 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:46.148650 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e908267c-314f-4f8f-95bb-355c1039c624 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:46.293366 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e908267c-314f-4f8f-95bb-355c1039c624 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:46.301626 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e908267c-314f-4f8f-95bb-355c1039c624 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:46.303141 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e908267c-314f-4f8f-95bb-355c1039c624 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:46.304311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e908267c-314f-4f8f-95bb-355c1039c624 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1724 microversion: 2.20 time: 0.169144 Jun 02 14:06:46.304901 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 521/1066] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:06:46 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:06:46.731423 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-881c9997-a60d-4e48-99d7-31a4175f8439 req-498fea21-6e56-4aae-acc3-7da73144b7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96011da5-6967-44e1-af2c-2ad76c52da74", "name": "network-vif-deleted", "tag": "ef61b669-91ec-4f6a-b126-1de24442c7c0"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:06:46.741705 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-881c9997-a60d-4e48-99d7-31a4175f8439 req-498fea21-6e56-4aae-acc3-7da73144b7a3 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:46.742155 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-881c9997-a60d-4e48-99d7-31a4175f8439 req-498fea21-6e56-4aae-acc3-7da73144b7a3 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:46.753202 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-881c9997-a60d-4e48-99d7-31a4175f8439 req-498fea21-6e56-4aae-acc3-7da73144b7a3 service nova] Creating event network-vif-deleted:ef61b669-91ec-4f6a-b126-1de24442c7c0 for instance 96011da5-6967-44e1-af2c-2ad76c52da74 on hv-cinder-82651 Jun 02 14:06:46.758510 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-881c9997-a60d-4e48-99d7-31a4175f8439 req-498fea21-6e56-4aae-acc3-7da73144b7a3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031170 Jun 02 14:06:46.759351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 546/1067] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:06:47.322938 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a2605d31-41fc-409a-a215-4f1887cc8208 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:47.323553 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a2605d31-41fc-409a-a215-4f1887cc8208 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:47.330833 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a2605d31-41fc-409a-a215-4f1887cc8208 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:47.331280 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a2605d31-41fc-409a-a215-4f1887cc8208 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:47.332043 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a2605d31-41fc-409a-a215-4f1887cc8208 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:47.332511 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a2605d31-41fc-409a-a215-4f1887cc8208 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:47.365480 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a2605d31-41fc-409a-a215-4f1887cc8208 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:47.365954 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a2605d31-41fc-409a-a215-4f1887cc8208 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:47.366399 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-a2605d31-41fc-409a-a215-4f1887cc8208 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lazy-loading 'fault' on Instance uuid 96011da5-6967-44e1-af2c-2ad76c52da74 {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:06:47.408544 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a2605d31-41fc-409a-a215-4f1887cc8208 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:47.416816 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a2605d31-41fc-409a-a215-4f1887cc8208 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:47.418350 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a2605d31-41fc-409a-a215-4f1887cc8208 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dd10f5fa400450fb64360391a871bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3f04e3f164a77b32b1e320d979863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:06:47.419651 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a2605d31-41fc-409a-a215-4f1887cc8208 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 200 len: 1371 microversion: 2.20 time: 0.100881 Jun 02 14:06:47.420382 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 522/1068] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:06:47 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 14:06:48.443628 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-487754ee-fc16-4642-98d0-29483ebeb956 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:48.444549 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-487754ee-fc16-4642-98d0-29483ebeb956 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:48.451076 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-487754ee-fc16-4642-98d0-29483ebeb956 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:48.451798 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-487754ee-fc16-4642-98d0-29483ebeb956 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:48.453630 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-487754ee-fc16-4642-98d0-29483ebeb956 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:48.454071 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-487754ee-fc16-4642-98d0-29483ebeb956 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:48.472689 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-487754ee-fc16-4642-98d0-29483ebeb956 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] HTTP exception thrown: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-487754ee-fc16-4642-98d0-29483ebeb956 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Request method failure captured: Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 HTTP/1.1 Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMD5fBY611s0IJQJMfIGFLSLVCOkBZHb_yepGHcJiB6KvP-MiQMyMxNg_CuchRnE2JWaPZoLKjlUnspRoiu7nL2pM9l0tLaxDdfmxHr37rQc2t69UpMK5zXrvgdtAb4cXP5mdI04Z3d9z5ZBdCKB6s2RR7dSIsT6jI1Q_fbNGVP_f8Y Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 56c3f04e3f164a77b32b1e320d979863 Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:06:48.474330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:06:48.475812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:06:48.475812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:48.475812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 56c3f04e3f164a77b32b1e320d979863 Jun 02 14:06:48.475812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:48.475812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-AttachVolumeShelveTestJSON-584569326-project Jun 02 14:06:48.475812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:06:48.475812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:06:48.475812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 4dd10f5fa400450fb64360391a871bb8 Jun 02 14:06:48.475812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-AttachVolumeShelveTestJSON-584569326-project Jun 02 14:06:48.475812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:06:48.475812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:48.475812 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': '96011da5-6967-44e1-af2c-2ad76c52da74'} Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:06:48.476640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:48.478228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:48.479578 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-487754ee-fc16-4642-98d0-29483ebeb956 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Returning 404 to user: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:06:48.479578 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-487754ee-fc16-4642-98d0-29483ebeb956 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 404 len: 111 microversion: 2.20 time: 0.036889 Jun 02 14:06:48.479578 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 547/1069] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:06:48 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 14:06:48.485343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-62a149ce-7f76-4f6d-b7a7-226640f4240b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '.version_select at 0x7fb72026c550>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:48.557835 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-62a149ce-7f76-4f6d-b7a7-226640f4240b tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116485922" status: 204 len: 0 microversion: 2.20 time: 0.076787 Jun 02 14:06:48.558413 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 523/1070] 10.222.0.33 () {60 vars in 1261 bytes} [Thu Jun 2 14:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116485922 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 14:06:50.614376 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-18eaadd3-a4dd-4eec-b850-8cfaf8228d32 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:50.614905 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-18eaadd3-a4dd-4eec-b850-8cfaf8228d32 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:50.621452 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-18eaadd3-a4dd-4eec-b850-8cfaf8228d32 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:50.621943 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-18eaadd3-a4dd-4eec-b850-8cfaf8228d32 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:50.622706 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-18eaadd3-a4dd-4eec-b850-8cfaf8228d32 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:50.623138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-18eaadd3-a4dd-4eec-b850-8cfaf8228d32 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:50.637097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-18eaadd3-a4dd-4eec-b850-8cfaf8228d32 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] HTTP exception thrown: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-18eaadd3-a4dd-4eec-b850-8cfaf8228d32 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Request method failure captured: Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: DELETE /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 HTTP/1.1 Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMD5fBY611s0IJQJMfIGFLSLVCOkBZHb_yepGHcJiB6KvP-MiQMyMxNg_CuchRnE2JWaPZoLKjlUnspRoiu7nL2pM9l0tLaxDdfmxHr37rQc2t69UpMK5zXrvgdtAb4cXP5mdI04Z3d9z5ZBdCKB6s2RR7dSIsT6jI1Q_fbNGVP_f8Y Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 56c3f04e3f164a77b32b1e320d979863 Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:06:50.638646 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:06:50.640805 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:06:50.640805 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:50.640805 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 56c3f04e3f164a77b32b1e320d979863 Jun 02 14:06:50.640805 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:50.640805 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-AttachVolumeShelveTestJSON-584569326-project Jun 02 14:06:50.640805 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:06:50.640805 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:06:50.640805 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 4dd10f5fa400450fb64360391a871bb8 Jun 02 14:06:50.640805 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-AttachVolumeShelveTestJSON-584569326-project Jun 02 14:06:50.640805 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:06:50.640805 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:50.640805 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': '96011da5-6967-44e1-af2c-2ad76c52da74'} Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:06:50.649940 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:50.651247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:50.652579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-18eaadd3-a4dd-4eec-b850-8cfaf8228d32 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Returning 404 to user: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:06:50.652579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-18eaadd3-a4dd-4eec-b850-8cfaf8228d32 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "DELETE /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 404 len: 111 microversion: 2.20 time: 0.030280 Jun 02 14:06:50.652579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 548/1071] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 2 14:06:50 2022] DELETE /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 14:06:50.658929 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-03781b29-e48c-48c4-b4e7-33bf86918ec1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:50.659540 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-03781b29-e48c-48c4-b4e7-33bf86918ec1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 96011da5-6967-44e1-af2c-2ad76c52da74] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:50.666647 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-03781b29-e48c-48c4-b4e7-33bf86918ec1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:50.667495 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-03781b29-e48c-48c4-b4e7-33bf86918ec1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:50.668332 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-03781b29-e48c-48c4-b4e7-33bf86918ec1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:50.668854 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-03781b29-e48c-48c4-b4e7-33bf86918ec1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:50.681953 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-03781b29-e48c-48c4-b4e7-33bf86918ec1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] HTTP exception thrown: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-03781b29-e48c-48c4-b4e7-33bf86918ec1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Request method failure captured: Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 HTTP/1.1 Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMD5fBY611s0IJQJMfIGFLSLVCOkBZHb_yepGHcJiB6KvP-MiQMyMxNg_CuchRnE2JWaPZoLKjlUnspRoiu7nL2pM9l0tLaxDdfmxHr37rQc2t69UpMK5zXrvgdtAb4cXP5mdI04Z3d9z5ZBdCKB6s2RR7dSIsT6jI1Q_fbNGVP_f8Y Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 56c3f04e3f164a77b32b1e320d979863 Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:06:50.683579 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:06:50.685374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:06:50.685374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:50.685374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 56c3f04e3f164a77b32b1e320d979863 Jun 02 14:06:50.685374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:50.685374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeShelveTestJSON-584569326-project Jun 02 14:06:50.685374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:06:50.685374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:06:50.685374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 4dd10f5fa400450fb64360391a871bb8 Jun 02 14:06:50.685374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeShelveTestJSON-584569326-project Jun 02 14:06:50.685374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:06:50.685374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:50.685374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '96011da5-6967-44e1-af2c-2ad76c52da74'} Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:06:50.686420 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. Jun 02 14:06:50.688004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:06:50.689487 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-03781b29-e48c-48c4-b4e7-33bf86918ec1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Returning 404 to user: Instance 96011da5-6967-44e1-af2c-2ad76c52da74 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:06:50.689487 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-03781b29-e48c-48c4-b4e7-33bf86918ec1 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74" status: 404 len: 111 microversion: 2.20 time: 0.031672 Jun 02 14:06:50.689487 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 524/1072] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:06:50 2022] GET /compute/v2.1/servers/96011da5-6967-44e1-af2c-2ad76c52da74 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 14:06:52.056621 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-53158abe-fe9f-4734-865d-98930b994046 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:52.057096 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-53158abe-fe9f-4734-865d-98930b994046 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:52.064230 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-53158abe-fe9f-4734-865d-98930b994046 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:52.064653 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-53158abe-fe9f-4734-865d-98930b994046 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:52.065413 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-53158abe-fe9f-4734-865d-98930b994046 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:52.065849 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-53158abe-fe9f-4734-865d-98930b994046 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:52.080000 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-53158abe-fe9f-4734-865d-98930b994046 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] HTTP exception thrown: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-53158abe-fe9f-4734-865d-98930b994046 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Request method failure captured: Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: DELETE /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 HTTP/1.1 Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMD5fBY611s0IJQJMfIGFLSLVCOkBZHb_yepGHcJiB6KvP-MiQMyMxNg_CuchRnE2JWaPZoLKjlUnspRoiu7nL2pM9l0tLaxDdfmxHr37rQc2t69UpMK5zXrvgdtAb4cXP5mdI04Z3d9z5ZBdCKB6s2RR7dSIsT6jI1Q_fbNGVP_f8Y Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 56c3f04e3f164a77b32b1e320d979863 Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:06:52.081563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:06:52.083210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:06:52.083210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:52.083210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 56c3f04e3f164a77b32b1e320d979863 Jun 02 14:06:52.083210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:52.083210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-AttachVolumeShelveTestJSON-584569326-project Jun 02 14:06:52.083210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:06:52.083210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:06:52.083210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 4dd10f5fa400450fb64360391a871bb8 Jun 02 14:06:52.083210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-AttachVolumeShelveTestJSON-584569326-project Jun 02 14:06:52.083210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:06:52.083210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:06:52.083210 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': '83d462ae-af14-4d5d-aab2-f45954429480'} Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:06:52.084396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:06:52.086097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:06:52.087730 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-53158abe-fe9f-4734-865d-98930b994046 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Returning 404 to user: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:06:52.087730 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-53158abe-fe9f-4734-865d-98930b994046 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 404 len: 111 microversion: 2.20 time: 0.030226 Jun 02 14:06:52.087730 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 549/1073] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 2 14:06:52 2022] DELETE /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 14:06:52.091435 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c1643518-c05b-44fe-892f-b565d65e8d39 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:06:52.092042 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c1643518-c05b-44fe-892f-b565d65e8d39 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] [instance: 83d462ae-af14-4d5d-aab2-f45954429480] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:06:52.098341 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c1643518-c05b-44fe-892f-b565d65e8d39 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:52.098732 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c1643518-c05b-44fe-892f-b565d65e8d39 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:52.099476 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c1643518-c05b-44fe-892f-b565d65e8d39 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:06:52.099900 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c1643518-c05b-44fe-892f-b565d65e8d39 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:06:52.113869 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-c1643518-c05b-44fe-892f-b565d65e8d39 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] HTTP exception thrown: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c1643518-c05b-44fe-892f-b565d65e8d39 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Request method failure captured: Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 HTTP/1.1 Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMD5fBY611s0IJQJMfIGFLSLVCOkBZHb_yepGHcJiB6KvP-MiQMyMxNg_CuchRnE2JWaPZoLKjlUnspRoiu7nL2pM9l0tLaxDdfmxHr37rQc2t69UpMK5zXrvgdtAb4cXP5mdI04Z3d9z5ZBdCKB6s2RR7dSIsT6jI1Q_fbNGVP_f8Y Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 56c3f04e3f164a77b32b1e320d979863 Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:06:52.115375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:06:52.117188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56c3f04e3f164a77b32b1e320d979863"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:06:52.117188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:52.117188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 56c3f04e3f164a77b32b1e320d979863 Jun 02 14:06:52.117188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-584569326 Jun 02 14:06:52.117188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeShelveTestJSON-584569326-project Jun 02 14:06:52.117188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:06:52.117188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:06:52.117188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 4dd10f5fa400450fb64360391a871bb8 Jun 02 14:06:52.117188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeShelveTestJSON-584569326-project Jun 02 14:06:52.117188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:06:52.117188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:06:52.117188 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '83d462ae-af14-4d5d-aab2-f45954429480'} Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:06:52.118066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. Jun 02 14:06:52.119282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:06:52.120447 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c1643518-c05b-44fe-892f-b565d65e8d39 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] Returning 404 to user: Instance 83d462ae-af14-4d5d-aab2-f45954429480 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:06:52.120447 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c1643518-c05b-44fe-892f-b565d65e8d39 tempest-AttachVolumeShelveTestJSON-584569326 tempest-AttachVolumeShelveTestJSON-584569326-project] 10.222.0.33 "GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480" status: 404 len: 111 microversion: 2.20 time: 0.029241 Jun 02 14:06:52.120447 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 525/1074] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 2 14:06:52 2022] GET /compute/v2.1/servers/83d462ae-af14-4d5d-aab2-f45954429480 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 14:07:21.890796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:07:21.891507 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Thu Jun 2 14:07:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:07:29.250196 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-16e16a65-f14e-4815-ad52-a1697bba0f2b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:07:29.250788 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-16e16a65-f14e-4815-ad52-a1697bba0f2b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:07:29.252806 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:29.253776 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:29.261016 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-16e16a65-f14e-4815-ad52-a1697bba0f2b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:29.262330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-16e16a65-f14e-4815-ad52-a1697bba0f2b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:29.262330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-16e16a65-f14e-4815-ad52-a1697bba0f2b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:29.262676 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-16e16a65-f14e-4815-ad52-a1697bba0f2b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:29.352655 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-16e16a65-f14e-4815-ad52-a1697bba0f2b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lazy-loading 'services' on Instance uuid e0222076-c3be-46b9-81c2-2f88404417aa {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:07:29.589781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-16e16a65-f14e-4815-ad52-a1697bba0f2b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/os-volume_attachments/9207a8ea-9ef6-4683-925a-ec08f911e8b5" status: 202 len: 0 microversion: 2.1 time: 0.343454 Jun 02 14:07:29.590280 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 550/1075] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 2 14:07:29 2022] DELETE /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/os-volume_attachments/9207a8ea-9ef6-4683-925a-ec08f911e8b5 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:07:31.764820 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-49717c79-bdd1-4281-bf65-b897c31d8c43 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:07:31.767310 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:31.767985 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=30 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:31.773792 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-49717c79-bdd1-4281-bf65-b897c31d8c43 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:31.774238 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-49717c79-bdd1-4281-bf65-b897c31d8c43 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:31.796867 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-49717c79-bdd1-4281-bf65-b897c31d8c43 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Going to try to stop instance {{(pid=118315) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 02 14:07:32.007788 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-49717c79-bdd1-4281-bf65-b897c31d8c43 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "POST /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/action" status: 202 len: 0 microversion: 2.1 time: 0.246772 Jun 02 14:07:32.008547 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 526/1076] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 2 14:07:31 2022] POST /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:07:32.215203 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-51c9e9f9-43b0-45a1-b951-9808a3c2ee58 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:07:32.215912 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-51c9e9f9-43b0-45a1-b951-9808a3c2ee58 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:07:32.222907 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-51c9e9f9-43b0-45a1-b951-9808a3c2ee58 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:32.223354 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-51c9e9f9-43b0-45a1-b951-9808a3c2ee58 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:32.224132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-51c9e9f9-43b0-45a1-b951-9808a3c2ee58 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:32.224599 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-51c9e9f9-43b0-45a1-b951-9808a3c2ee58 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:32.357477 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-51c9e9f9-43b0-45a1-b951-9808a3c2ee58 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:07:32.365736 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-51c9e9f9-43b0-45a1-b951-9808a3c2ee58 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1678 microversion: 2.1 time: 0.352897 Jun 02 14:07:32.366313 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 551/1077] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:07:32 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1678 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:07:33.384266 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-be33a322-af44-4f62-af65-0c113da17783 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:07:33.385003 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-be33a322-af44-4f62-af65-0c113da17783 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:07:33.391192 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-be33a322-af44-4f62-af65-0c113da17783 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:33.391640 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-be33a322-af44-4f62-af65-0c113da17783 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:33.392419 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-be33a322-af44-4f62-af65-0c113da17783 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:33.392861 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-be33a322-af44-4f62-af65-0c113da17783 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:33.533557 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-be33a322-af44-4f62-af65-0c113da17783 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:07:33.541723 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-be33a322-af44-4f62-af65-0c113da17783 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1678 microversion: 2.1 time: 0.162262 Jun 02 14:07:33.542281 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 527/1078] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:07:33 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:07:34.558801 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e2ef0a10-689f-462d-8eea-1b753e16c6d0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:07:34.559415 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e2ef0a10-689f-462d-8eea-1b753e16c6d0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:07:34.570490 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e2ef0a10-689f-462d-8eea-1b753e16c6d0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:34.570949 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e2ef0a10-689f-462d-8eea-1b753e16c6d0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:34.571728 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e2ef0a10-689f-462d-8eea-1b753e16c6d0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:34.572180 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e2ef0a10-689f-462d-8eea-1b753e16c6d0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:34.716096 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e2ef0a10-689f-462d-8eea-1b753e16c6d0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:07:34.724019 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e2ef0a10-689f-462d-8eea-1b753e16c6d0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1678 microversion: 2.1 time: 0.169262 Jun 02 14:07:34.724631 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 552/1079] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:07:34 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:07:35.741782 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b850a943-d74f-43df-ad41-8b67a608e047 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:07:35.742382 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b850a943-d74f-43df-ad41-8b67a608e047 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:07:35.749019 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b850a943-d74f-43df-ad41-8b67a608e047 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:35.749401 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b850a943-d74f-43df-ad41-8b67a608e047 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:35.750158 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b850a943-d74f-43df-ad41-8b67a608e047 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:35.750588 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b850a943-d74f-43df-ad41-8b67a608e047 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:35.882507 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b850a943-d74f-43df-ad41-8b67a608e047 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:07:35.892302 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b850a943-d74f-43df-ad41-8b67a608e047 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1678 microversion: 2.1 time: 0.154957 Jun 02 14:07:35.892902 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 528/1080] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:07:35 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:07:36.909429 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-60121697-9ee2-4f66-b870-e6093c8f38d6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:07:36.910647 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-60121697-9ee2-4f66-b870-e6093c8f38d6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:07:36.917326 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-60121697-9ee2-4f66-b870-e6093c8f38d6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:36.917765 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-60121697-9ee2-4f66-b870-e6093c8f38d6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:36.918546 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-60121697-9ee2-4f66-b870-e6093c8f38d6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:36.918972 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-60121697-9ee2-4f66-b870-e6093c8f38d6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:37.054865 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-60121697-9ee2-4f66-b870-e6093c8f38d6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:07:37.062268 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-60121697-9ee2-4f66-b870-e6093c8f38d6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1678 microversion: 2.1 time: 0.156787 Jun 02 14:07:37.062823 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 553/1081] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:07:36 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:07:38.079397 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ee99e6f1-57ee-4971-b996-99338202a640 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:07:38.079990 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ee99e6f1-57ee-4971-b996-99338202a640 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:07:38.086581 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ee99e6f1-57ee-4971-b996-99338202a640 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:38.087026 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ee99e6f1-57ee-4971-b996-99338202a640 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:38.087783 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ee99e6f1-57ee-4971-b996-99338202a640 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:38.088218 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ee99e6f1-57ee-4971-b996-99338202a640 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:38.225563 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ee99e6f1-57ee-4971-b996-99338202a640 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:07:38.236636 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ee99e6f1-57ee-4971-b996-99338202a640 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1678 microversion: 2.1 time: 0.161016 Jun 02 14:07:38.237218 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 529/1082] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:07:38 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:07:39.255798 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c3404155-289e-4193-a96f-0c9a7a0578f2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:07:39.256597 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c3404155-289e-4193-a96f-0c9a7a0578f2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:07:39.263671 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c3404155-289e-4193-a96f-0c9a7a0578f2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:39.264208 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c3404155-289e-4193-a96f-0c9a7a0578f2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:39.273791 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c3404155-289e-4193-a96f-0c9a7a0578f2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:39.273791 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c3404155-289e-4193-a96f-0c9a7a0578f2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:39.400710 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c3404155-289e-4193-a96f-0c9a7a0578f2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:07:39.408244 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c3404155-289e-4193-a96f-0c9a7a0578f2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1678 microversion: 2.1 time: 0.157763 Jun 02 14:07:39.408830 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 554/1083] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:07:39 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:07:40.424989 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a8e16a0f-e324-41a4-8189-98ce5ba8f230 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:07:40.425594 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a8e16a0f-e324-41a4-8189-98ce5ba8f230 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:07:40.432136 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8e16a0f-e324-41a4-8189-98ce5ba8f230 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:40.432608 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8e16a0f-e324-41a4-8189-98ce5ba8f230 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:40.433355 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8e16a0f-e324-41a4-8189-98ce5ba8f230 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:40.433785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a8e16a0f-e324-41a4-8189-98ce5ba8f230 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:40.563107 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a8e16a0f-e324-41a4-8189-98ce5ba8f230 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:07:40.571538 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a8e16a0f-e324-41a4-8189-98ce5ba8f230 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1678 microversion: 2.1 time: 0.150432 Jun 02 14:07:40.572093 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 530/1084] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:07:40 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:07:41.589091 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7452f1cd-ae0f-40b7-9b77-430f208990a5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:07:41.589629 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7452f1cd-ae0f-40b7-9b77-430f208990a5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:07:41.596209 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7452f1cd-ae0f-40b7-9b77-430f208990a5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:41.596702 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7452f1cd-ae0f-40b7-9b77-430f208990a5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:41.597461 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7452f1cd-ae0f-40b7-9b77-430f208990a5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:41.598002 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7452f1cd-ae0f-40b7-9b77-430f208990a5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:41.729313 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7452f1cd-ae0f-40b7-9b77-430f208990a5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:07:41.736965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7452f1cd-ae0f-40b7-9b77-430f208990a5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1678 microversion: 2.1 time: 0.152217 Jun 02 14:07:41.737535 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 555/1085] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:07:41 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:07:42.755323 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-114e5367-10b9-4760-bdbf-5ba7925a1fe5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:07:42.755854 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-114e5367-10b9-4760-bdbf-5ba7925a1fe5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:07:42.762439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-114e5367-10b9-4760-bdbf-5ba7925a1fe5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:42.762890 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-114e5367-10b9-4760-bdbf-5ba7925a1fe5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:42.763653 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-114e5367-10b9-4760-bdbf-5ba7925a1fe5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:42.764088 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-114e5367-10b9-4760-bdbf-5ba7925a1fe5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:42.893511 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-114e5367-10b9-4760-bdbf-5ba7925a1fe5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:07:42.901944 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-114e5367-10b9-4760-bdbf-5ba7925a1fe5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1655 microversion: 2.1 time: 0.151266 Jun 02 14:07:42.902513 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 531/1086] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:07:42 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:07:42.918561 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-32989aa5-5ee5-4055-8cc4-17e8f670f287 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:07:42.925609 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-32989aa5-5ee5-4055-8cc4-17e8f670f287 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:42.926655 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-32989aa5-5ee5-4055-8cc4-17e8f670f287 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:42.991194 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-32989aa5-5ee5-4055-8cc4-17e8f670f287 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Going to try to start instance {{(pid=118316) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 02 14:07:43.192546 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-32989aa5-5ee5-4055-8cc4-17e8f670f287 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "POST /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/action" status: 202 len: 0 microversion: 2.1 time: 0.277660 Jun 02 14:07:43.193577 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 556/1087] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 2 14:07:42 2022] POST /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:07:43.202179 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c444bc87-147c-470a-9087-b8c86a242cbd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:07:43.202868 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c444bc87-147c-470a-9087-b8c86a242cbd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:07:43.209457 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c444bc87-147c-470a-9087-b8c86a242cbd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:43.209912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c444bc87-147c-470a-9087-b8c86a242cbd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:43.210743 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c444bc87-147c-470a-9087-b8c86a242cbd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:43.211182 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c444bc87-147c-470a-9087-b8c86a242cbd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:43.350647 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c444bc87-147c-470a-9087-b8c86a242cbd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:07:43.358065 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c444bc87-147c-470a-9087-b8c86a242cbd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1664 microversion: 2.1 time: 0.159709 Jun 02 14:07:43.358627 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 532/1088] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:07:43 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:07:44.377873 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-44cf815f-c501-4b34-b03c-0fdc027b11e1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:07:44.378579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-44cf815f-c501-4b34-b03c-0fdc027b11e1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:07:44.385024 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44cf815f-c501-4b34-b03c-0fdc027b11e1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:44.385472 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44cf815f-c501-4b34-b03c-0fdc027b11e1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:44.386227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44cf815f-c501-4b34-b03c-0fdc027b11e1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:44.386667 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-44cf815f-c501-4b34-b03c-0fdc027b11e1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:44.520942 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-44cf815f-c501-4b34-b03c-0fdc027b11e1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:07:44.528332 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-44cf815f-c501-4b34-b03c-0fdc027b11e1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1664 microversion: 2.1 time: 0.155223 Jun 02 14:07:44.528922 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 557/1089] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:07:44 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:07:45.545676 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7611b8fd-09f2-45a1-b160-18b7a2f52343 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:07:45.546322 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7611b8fd-09f2-45a1-b160-18b7a2f52343 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:07:45.553627 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7611b8fd-09f2-45a1-b160-18b7a2f52343 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:45.554073 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7611b8fd-09f2-45a1-b160-18b7a2f52343 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:45.554839 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7611b8fd-09f2-45a1-b160-18b7a2f52343 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:07:45.555271 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7611b8fd-09f2-45a1-b160-18b7a2f52343 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:07:45.682893 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7611b8fd-09f2-45a1-b160-18b7a2f52343 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:07:45.690409 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7611b8fd-09f2-45a1-b160-18b7a2f52343 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1668 microversion: 2.1 time: 0.148645 Jun 02 14:07:45.690986 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 533/1090] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:07:45 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1668 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:00.902374 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-fb40588a-ec0e-4533-9d15-0bc84df774ac tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:00.903470 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-fb40588a-ec0e-4533-9d15-0bc84df774ac tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:00.905624 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-2caae49a-cb26-4d87-a399-8bd87ca98c68 req-e21a5f45-5fe7-41b0-be3c-3cdaa1a6f481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53c5aefc-4310-48eb-87c7-de7e8846e33a", "tag": "cf30a33b-364e-4150-81f4-9ce2821f6b5d"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:08:00.906980 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=16 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:00.908044 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:00.910307 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=16 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:00.910985 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:00.914683 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fb40588a-ec0e-4533-9d15-0bc84df774ac tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:00.915399 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fb40588a-ec0e-4533-9d15-0bc84df774ac tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:00.916445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fb40588a-ec0e-4533-9d15-0bc84df774ac tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:00.917087 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fb40588a-ec0e-4533-9d15-0bc84df774ac tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:00.919462 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-2caae49a-cb26-4d87-a399-8bd87ca98c68 req-e21a5f45-5fe7-41b0-be3c-3cdaa1a6f481 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:00.920183 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-2caae49a-cb26-4d87-a399-8bd87ca98c68 req-e21a5f45-5fe7-41b0-be3c-3cdaa1a6f481 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:00.931510 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-2caae49a-cb26-4d87-a399-8bd87ca98c68 req-e21a5f45-5fe7-41b0-be3c-3cdaa1a6f481 service nova] Creating event network-changed:cf30a33b-364e-4150-81f4-9ce2821f6b5d for instance 53c5aefc-4310-48eb-87c7-de7e8846e33a on hv-cinder-82651 Jun 02 14:08:00.936739 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-2caae49a-cb26-4d87-a399-8bd87ca98c68 req-e21a5f45-5fe7-41b0-be3c-3cdaa1a6f481 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035127 Jun 02 14:08:00.937529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 534/1091] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:08:00.943853 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-fb40588a-ec0e-4533-9d15-0bc84df774ac tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Going to try to terminate instance {{(pid=118316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:08:01.231936 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-fb40588a-ec0e-4533-9d15-0bc84df774ac tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "DELETE /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 204 len: 0 microversion: 2.1 time: 0.333337 Jun 02 14:08:01.232558 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 558/1092] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:08:00 2022] DELETE /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:08:01.242450 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3622d01b-6847-41c8-9099-ba6a1156e926 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:01.243469 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3622d01b-6847-41c8-9099-ba6a1156e926 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:01.250080 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3622d01b-6847-41c8-9099-ba6a1156e926 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:01.254221 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3622d01b-6847-41c8-9099-ba6a1156e926 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:01.254221 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3622d01b-6847-41c8-9099-ba6a1156e926 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:01.254221 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3622d01b-6847-41c8-9099-ba6a1156e926 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:01.405165 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3622d01b-6847-41c8-9099-ba6a1156e926 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:01.413113 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3622d01b-6847-41c8-9099-ba6a1156e926 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1576 microversion: 2.1 time: 0.176010 Jun 02 14:08:01.413685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 535/1093] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:01 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:02.432134 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f5040c71-bbc1-434e-8cb1-365579167875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:02.432764 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f5040c71-bbc1-434e-8cb1-365579167875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:02.439425 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f5040c71-bbc1-434e-8cb1-365579167875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:02.439872 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f5040c71-bbc1-434e-8cb1-365579167875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:02.440643 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f5040c71-bbc1-434e-8cb1-365579167875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:02.441070 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f5040c71-bbc1-434e-8cb1-365579167875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:02.575642 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f5040c71-bbc1-434e-8cb1-365579167875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:02.583145 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f5040c71-bbc1-434e-8cb1-365579167875 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1576 microversion: 2.1 time: 0.156072 Jun 02 14:08:02.584207 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 559/1094] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:02 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:02.962884 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-943b9b07-aded-48fb-87de-0be68aaab039 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:02.963399 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-943b9b07-aded-48fb-87de-0be68aaab039 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:02.969583 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-943b9b07-aded-48fb-87de-0be68aaab039 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:02.970034 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-943b9b07-aded-48fb-87de-0be68aaab039 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:02.970804 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-943b9b07-aded-48fb-87de-0be68aaab039 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:02.971245 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-943b9b07-aded-48fb-87de-0be68aaab039 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:02.996602 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-943b9b07-aded-48fb-87de-0be68aaab039 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a/ips" status: 200 len: 148 microversion: 2.1 time: 0.171716 Jun 02 14:08:02.997158 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 536/1095] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 2 14:08:02 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a/ips => generated 148 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:08:03.601204 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9fd214f8-9a35-4c80-9b18-0147d97bcf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:03.601827 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9fd214f8-9a35-4c80-9b18-0147d97bcf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:03.607958 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9fd214f8-9a35-4c80-9b18-0147d97bcf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:03.608414 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9fd214f8-9a35-4c80-9b18-0147d97bcf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:03.609167 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9fd214f8-9a35-4c80-9b18-0147d97bcf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:03.609594 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9fd214f8-9a35-4c80-9b18-0147d97bcf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:03.742709 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9fd214f8-9a35-4c80-9b18-0147d97bcf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:03.750219 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9fd214f8-9a35-4c80-9b18-0147d97bcf27 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1576 microversion: 2.1 time: 0.153831 Jun 02 14:08:03.750780 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 560/1096] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:03 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:04.767100 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-67b0b800-1ff7-427c-af8f-51cd232ec845 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:04.767662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-67b0b800-1ff7-427c-af8f-51cd232ec845 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:04.774389 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-67b0b800-1ff7-427c-af8f-51cd232ec845 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:04.774837 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-67b0b800-1ff7-427c-af8f-51cd232ec845 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:04.775597 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-67b0b800-1ff7-427c-af8f-51cd232ec845 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:04.776032 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-67b0b800-1ff7-427c-af8f-51cd232ec845 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:04.915791 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-67b0b800-1ff7-427c-af8f-51cd232ec845 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:04.924219 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-67b0b800-1ff7-427c-af8f-51cd232ec845 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1576 microversion: 2.1 time: 0.161012 Jun 02 14:08:04.925184 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 537/1097] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:04 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:05.356038 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-100644b5-b884-433f-9c65-7e0830a1d1a9 req-8ad8a2fe-8138-45a8-9088-740b13fb5eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53c5aefc-4310-48eb-87c7-de7e8846e33a", "name": "network-vif-deleted", "tag": "cf30a33b-364e-4150-81f4-9ce2821f6b5d"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:08:05.364684 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-100644b5-b884-433f-9c65-7e0830a1d1a9 req-8ad8a2fe-8138-45a8-9088-740b13fb5eff service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:05.367325 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-100644b5-b884-433f-9c65-7e0830a1d1a9 req-8ad8a2fe-8138-45a8-9088-740b13fb5eff service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:05.377334 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-100644b5-b884-433f-9c65-7e0830a1d1a9 req-8ad8a2fe-8138-45a8-9088-740b13fb5eff service nova] Creating event network-vif-deleted:cf30a33b-364e-4150-81f4-9ce2821f6b5d for instance 53c5aefc-4310-48eb-87c7-de7e8846e33a on hv-cinder-82651 Jun 02 14:08:05.384327 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-100644b5-b884-433f-9c65-7e0830a1d1a9 req-8ad8a2fe-8138-45a8-9088-740b13fb5eff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031524 Jun 02 14:08:05.385159 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 561/1098] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:08:05.942229 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ca5346cd-12ab-491f-bf02-9bb3ef4daa71 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:05.943561 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ca5346cd-12ab-491f-bf02-9bb3ef4daa71 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:05.950013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ca5346cd-12ab-491f-bf02-9bb3ef4daa71 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:05.950461 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ca5346cd-12ab-491f-bf02-9bb3ef4daa71 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:05.951222 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ca5346cd-12ab-491f-bf02-9bb3ef4daa71 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:05.951659 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ca5346cd-12ab-491f-bf02-9bb3ef4daa71 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:06.012540 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ca5346cd-12ab-491f-bf02-9bb3ef4daa71 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:06.019895 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ca5346cd-12ab-491f-bf02-9bb3ef4daa71 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1225 microversion: 2.1 time: 0.081799 Jun 02 14:08:06.020486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 538/1099] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:05 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:07.039209 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c397fdce-90d6-4480-a112-42e235897186 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:07.039907 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c397fdce-90d6-4480-a112-42e235897186 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:07.046611 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c397fdce-90d6-4480-a112-42e235897186 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:07.047093 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c397fdce-90d6-4480-a112-42e235897186 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:07.047857 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c397fdce-90d6-4480-a112-42e235897186 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:07.048383 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c397fdce-90d6-4480-a112-42e235897186 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:07.113839 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c397fdce-90d6-4480-a112-42e235897186 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:07.121714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c397fdce-90d6-4480-a112-42e235897186 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 200 len: 1225 microversion: 2.1 time: 0.087946 Jun 02 14:08:07.122432 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 562/1100] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:07 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:07.801547 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f8582e3b-6d72-45b8-b8f8-6e953e1072cb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e89ff78d-a09c-438a-b92e-de9e8ae8d3ea"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:08:07.801547 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f8582e3b-6d72-45b8-b8f8-6e953e1072cb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:07.808766 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f8582e3b-6d72-45b8-b8f8-6e953e1072cb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:07.809226 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f8582e3b-6d72-45b8-b8f8-6e953e1072cb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:07.810006 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f8582e3b-6d72-45b8-b8f8-6e953e1072cb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:07.810456 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f8582e3b-6d72-45b8-b8f8-6e953e1072cb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:08.139867 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-536c3430-6531-4903-a692-e0e96f3d1ff7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:08.140641 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-536c3430-6531-4903-a692-e0e96f3d1ff7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 53c5aefc-4310-48eb-87c7-de7e8846e33a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:08.147318 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-536c3430-6531-4903-a692-e0e96f3d1ff7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:08.147768 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-536c3430-6531-4903-a692-e0e96f3d1ff7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:08.148567 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-536c3430-6531-4903-a692-e0e96f3d1ff7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:08.149176 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-536c3430-6531-4903-a692-e0e96f3d1ff7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:08.163704 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-536c3430-6531-4903-a692-e0e96f3d1ff7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] HTTP exception thrown: Instance 53c5aefc-4310-48eb-87c7-de7e8846e33a could not be found. Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-536c3430-6531-4903-a692-e0e96f3d1ff7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Request method failure captured: Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a HTTP/1.1 Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMF5gKYp9MMUFShZJvK8HWskj9c8oo7jw4xQHHv76ViSQZdjAaCopsHmNg9Z6OlkZCBQnmUJyI1SOwkTMxzwheYZ0C-B6ggUiF5fmge5TxytZPk01P0tct8Tp6fYqDzP4loJskleQvKj6QFPBiOoAalNEK-boGqHEgSQ0NKEALPF9pU Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: b55a34a53b2740d9af5efd660424a456 Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-TestVolumeBootPattern-587815091 Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:08:08.165382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:08:08.167015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b55a34a53b2740d9af5efd660424a456"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:08:08.167015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-TestVolumeBootPattern-587815091 Jun 02 14:08:08.167015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: b55a34a53b2740d9af5efd660424a456 Jun 02 14:08:08.167015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-TestVolumeBootPattern-587815091 Jun 02 14:08:08.167015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-TestVolumeBootPattern-587815091-project Jun 02 14:08:08.167015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:08:08.167015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:08:08.167015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 315c0d9d9a284389ae07bf898c330605 Jun 02 14:08:08.167015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-TestVolumeBootPattern-587815091-project Jun 02 14:08:08.167015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:08:08.167015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance 53c5aefc-4310-48eb-87c7-de7e8846e33a could not be found. Jun 02 14:08:08.167015 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': '53c5aefc-4310-48eb-87c7-de7e8846e33a'} Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53c5aefc-4310-48eb-87c7-de7e8846e33a could not be found. Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:08:08.168330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53c5aefc-4310-48eb-87c7-de7e8846e33a could not be found. Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53c5aefc-4310-48eb-87c7-de7e8846e33a could not be found. Jun 02 14:08:08.170005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:08.171743 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-536c3430-6531-4903-a692-e0e96f3d1ff7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Returning 404 to user: Instance 53c5aefc-4310-48eb-87c7-de7e8846e33a could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:08:08.171743 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-536c3430-6531-4903-a692-e0e96f3d1ff7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a" status: 404 len: 111 microversion: 2.1 time: 0.031971 Jun 02 14:08:08.171743 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 563/1101] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:08 2022] GET /compute/v2.1/servers/53c5aefc-4310-48eb-87c7-de7e8846e33a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 14:08:08.629600 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f8582e3b-6d72-45b8-b8f8-6e953e1072cb tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "POST /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.835604 Jun 02 14:08:08.630215 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 539/1102] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 2 14:08:07 2022] POST /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:08:12.871674 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d3f3aa74-7c2f-4e8d-91ea-12ebc5ccf164 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:12.872316 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d3f3aa74-7c2f-4e8d-91ea-12ebc5ccf164 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:12.880848 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d3f3aa74-7c2f-4e8d-91ea-12ebc5ccf164 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:12.881536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d3f3aa74-7c2f-4e8d-91ea-12ebc5ccf164 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:12.882328 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d3f3aa74-7c2f-4e8d-91ea-12ebc5ccf164 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:12.882955 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d3f3aa74-7c2f-4e8d-91ea-12ebc5ccf164 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:12.885462 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-49077586-93f4-400c-8d1d-4eb4b545e432 req-a4e6b55c-e7d9-44d3-9563-d5b4adf61f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d778df4-cdc9-440b-acda-4b10357cb31f", "tag": "1bbbd139-07e3-43f6-afa9-e2d8b6eb9d5e"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:08:12.898442 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-49077586-93f4-400c-8d1d-4eb4b545e432 req-a4e6b55c-e7d9-44d3-9563-d5b4adf61f1e service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:12.898905 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-49077586-93f4-400c-8d1d-4eb4b545e432 req-a4e6b55c-e7d9-44d3-9563-d5b4adf61f1e service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:12.910804 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-49077586-93f4-400c-8d1d-4eb4b545e432 req-a4e6b55c-e7d9-44d3-9563-d5b4adf61f1e service nova] Creating event network-changed:1bbbd139-07e3-43f6-afa9-e2d8b6eb9d5e for instance 6d778df4-cdc9-440b-acda-4b10357cb31f on hv-cinder-82651 Jun 02 14:08:12.913835 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d3f3aa74-7c2f-4e8d-91ea-12ebc5ccf164 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Going to try to terminate instance {{(pid=118316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:08:12.917763 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-49077586-93f4-400c-8d1d-4eb4b545e432 req-a4e6b55c-e7d9-44d3-9563-d5b4adf61f1e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036778 Jun 02 14:08:12.919118 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 540/1103] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:08:13.272449 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d3f3aa74-7c2f-4e8d-91ea-12ebc5ccf164 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 204 len: 0 microversion: 2.1 time: 0.404288 Jun 02 14:08:13.273025 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 564/1104] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:08:12 2022] DELETE /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:08:13.281850 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e7670b9f-b25e-4361-b86b-a38e2bf184ed tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:13.282559 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e7670b9f-b25e-4361-b86b-a38e2bf184ed tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:13.289261 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7670b9f-b25e-4361-b86b-a38e2bf184ed tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:13.289713 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7670b9f-b25e-4361-b86b-a38e2bf184ed tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:13.290487 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7670b9f-b25e-4361-b86b-a38e2bf184ed tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:13.290926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e7670b9f-b25e-4361-b86b-a38e2bf184ed tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:13.424858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e7670b9f-b25e-4361-b86b-a38e2bf184ed tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:13.433183 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e7670b9f-b25e-4361-b86b-a38e2bf184ed tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1577 microversion: 2.1 time: 0.155624 Jun 02 14:08:13.433766 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 541/1105] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:13 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:14.451669 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-53afba59-76d1-47ed-9814-f99c77bd6f3a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:14.452372 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-53afba59-76d1-47ed-9814-f99c77bd6f3a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:14.458927 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-53afba59-76d1-47ed-9814-f99c77bd6f3a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:14.459472 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-53afba59-76d1-47ed-9814-f99c77bd6f3a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:14.460232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-53afba59-76d1-47ed-9814-f99c77bd6f3a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:14.460703 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-53afba59-76d1-47ed-9814-f99c77bd6f3a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:14.594278 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-53afba59-76d1-47ed-9814-f99c77bd6f3a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:14.602747 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-53afba59-76d1-47ed-9814-f99c77bd6f3a tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1577 microversion: 2.1 time: 0.155304 Jun 02 14:08:14.603319 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 565/1106] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:14 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:15.620604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-54f0a8a9-4f8b-46ac-ae35-08ef579c6985 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:15.621170 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-54f0a8a9-4f8b-46ac-ae35-08ef579c6985 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:15.627603 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54f0a8a9-4f8b-46ac-ae35-08ef579c6985 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:15.628045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54f0a8a9-4f8b-46ac-ae35-08ef579c6985 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:15.628836 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54f0a8a9-4f8b-46ac-ae35-08ef579c6985 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:15.629267 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-54f0a8a9-4f8b-46ac-ae35-08ef579c6985 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:15.760140 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-54f0a8a9-4f8b-46ac-ae35-08ef579c6985 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:15.768008 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-54f0a8a9-4f8b-46ac-ae35-08ef579c6985 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1577 microversion: 2.1 time: 0.151358 Jun 02 14:08:15.768617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 542/1107] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:15 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:16.790559 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f58d3293-c887-4471-a4a6-89d2b353360e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:16.791172 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f58d3293-c887-4471-a4a6-89d2b353360e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:16.798450 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f58d3293-c887-4471-a4a6-89d2b353360e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:16.798894 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f58d3293-c887-4471-a4a6-89d2b353360e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:16.799680 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f58d3293-c887-4471-a4a6-89d2b353360e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:16.800131 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f58d3293-c887-4471-a4a6-89d2b353360e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:16.934471 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f58d3293-c887-4471-a4a6-89d2b353360e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:16.942042 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f58d3293-c887-4471-a4a6-89d2b353360e tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1577 microversion: 2.1 time: 0.155430 Jun 02 14:08:16.943068 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 566/1108] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:16 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:08:17.960344 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1e168ac7-4cfc-4984-9049-99f8e56eefd0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:17.962963 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1e168ac7-4cfc-4984-9049-99f8e56eefd0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:17.967829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e168ac7-4cfc-4984-9049-99f8e56eefd0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:17.968284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e168ac7-4cfc-4984-9049-99f8e56eefd0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:17.969098 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e168ac7-4cfc-4984-9049-99f8e56eefd0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:17.969535 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1e168ac7-4cfc-4984-9049-99f8e56eefd0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:18.118768 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1e168ac7-4cfc-4984-9049-99f8e56eefd0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:18.136008 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1e168ac7-4cfc-4984-9049-99f8e56eefd0 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1577 microversion: 2.1 time: 0.179523 Jun 02 14:08:18.137535 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 543/1109] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:17 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:18.380825 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-94809e3e-aef5-40c6-9c05-d972c24344ff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:18.380825 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-94809e3e-aef5-40c6-9c05-d972c24344ff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:18.387233 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-94809e3e-aef5-40c6-9c05-d972c24344ff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:18.387760 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-94809e3e-aef5-40c6-9c05-d972c24344ff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:18.388676 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-94809e3e-aef5-40c6-9c05-d972c24344ff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:18.389169 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-94809e3e-aef5-40c6-9c05-d972c24344ff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:18.471750 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-b70a7f72-5be4-426b-ba3e-928343b8dd4a req-74d7b189-e1a0-4739-ac75-899a3fbfa5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d778df4-cdc9-440b-acda-4b10357cb31f", "name": "network-vif-deleted", "tag": "1bbbd139-07e3-43f6-afa9-e2d8b6eb9d5e"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:08:18.482388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-b70a7f72-5be4-426b-ba3e-928343b8dd4a req-74d7b189-e1a0-4739-ac75-899a3fbfa5aa service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:18.486076 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-b70a7f72-5be4-426b-ba3e-928343b8dd4a req-74d7b189-e1a0-4739-ac75-899a3fbfa5aa service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:18.488700 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-94809e3e-aef5-40c6-9c05-d972c24344ff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lazy-loading 'services' on Instance uuid 902069a0-6b09-40fd-b5b9-23530be90d8a {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:08:18.495765 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-b70a7f72-5be4-426b-ba3e-928343b8dd4a req-74d7b189-e1a0-4739-ac75-899a3fbfa5aa service nova] Creating event network-vif-deleted:1bbbd139-07e3-43f6-afa9-e2d8b6eb9d5e for instance 6d778df4-cdc9-440b-acda-4b10357cb31f on hv-cinder-82651 Jun 02 14:08:18.500816 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-b70a7f72-5be4-426b-ba3e-928343b8dd4a req-74d7b189-e1a0-4739-ac75-899a3fbfa5aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032897 Jun 02 14:08:18.501725 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 544/1110] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:08:18.756477 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-94809e3e-aef5-40c6-9c05-d972c24344ff tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a/os-volume_attachments/e89ff78d-a09c-438a-b92e-de9e8ae8d3ea" status: 202 len: 0 microversion: 2.1 time: 0.386480 Jun 02 14:08:18.757280 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 567/1111] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 2 14:08:18 2022] DELETE /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a/os-volume_attachments/e89ff78d-a09c-438a-b92e-de9e8ae8d3ea => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:08:18.766507 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a6097714-2497-41d1-8544-b03d451d042b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:18.767796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a6097714-2497-41d1-8544-b03d451d042b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:18.775619 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a6097714-2497-41d1-8544-b03d451d042b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:18.776352 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a6097714-2497-41d1-8544-b03d451d042b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:18.777169 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a6097714-2497-41d1-8544-b03d451d042b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:18.777610 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a6097714-2497-41d1-8544-b03d451d042b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:18.809653 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a6097714-2497-41d1-8544-b03d451d042b tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047415 Jun 02 14:08:18.810101 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 545/1112] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:08:18 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:08:19.155314 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-88e8dde1-539e-418e-af32-116015a610c3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:19.155933 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-88e8dde1-539e-418e-af32-116015a610c3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:19.162200 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-88e8dde1-539e-418e-af32-116015a610c3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:19.162667 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-88e8dde1-539e-418e-af32-116015a610c3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:19.164007 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-88e8dde1-539e-418e-af32-116015a610c3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:19.168640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-88e8dde1-539e-418e-af32-116015a610c3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:19.229300 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-88e8dde1-539e-418e-af32-116015a610c3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:19.236905 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-88e8dde1-539e-418e-af32-116015a610c3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1226 microversion: 2.1 time: 0.086025 Jun 02 14:08:19.237498 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 568/1113] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:19 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:19.822338 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1f22a753-5dbd-43af-965f-c64a2d0d8c70 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:19.823277 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1f22a753-5dbd-43af-965f-c64a2d0d8c70 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:19.829763 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1f22a753-5dbd-43af-965f-c64a2d0d8c70 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:19.830201 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1f22a753-5dbd-43af-965f-c64a2d0d8c70 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:19.831021 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1f22a753-5dbd-43af-965f-c64a2d0d8c70 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:19.831444 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1f22a753-5dbd-43af-965f-c64a2d0d8c70 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:19.861781 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1f22a753-5dbd-43af-965f-c64a2d0d8c70 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044389 Jun 02 14:08:19.862337 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 546/1114] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:08:19 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:08:20.253754 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-45acad0c-d901-4692-9426-b481be54b1a7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:20.254349 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-45acad0c-d901-4692-9426-b481be54b1a7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:20.261496 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-45acad0c-d901-4692-9426-b481be54b1a7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:20.261974 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-45acad0c-d901-4692-9426-b481be54b1a7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:20.262738 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-45acad0c-d901-4692-9426-b481be54b1a7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:20.263176 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-45acad0c-d901-4692-9426-b481be54b1a7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:20.294719 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-45acad0c-d901-4692-9426-b481be54b1a7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:20.295170 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-45acad0c-d901-4692-9426-b481be54b1a7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:20.295616 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-45acad0c-d901-4692-9426-b481be54b1a7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lazy-loading 'fault' on Instance uuid 6d778df4-cdc9-440b-acda-4b10357cb31f {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:08:20.342017 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-45acad0c-d901-4692-9426-b481be54b1a7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315c0d9d9a284389ae07bf898c330605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55a34a53b2740d9af5efd660424a456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:20.350029 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-45acad0c-d901-4692-9426-b481be54b1a7 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 200 len: 1231 microversion: 2.1 time: 0.100113 Jun 02 14:08:20.350602 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 569/1115] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:20 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:20.874660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-14255e10-708d-4566-b740-d925d9987684 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:20.875622 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-14255e10-708d-4566-b740-d925d9987684 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:20.882517 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-14255e10-708d-4566-b740-d925d9987684 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:20.882978 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-14255e10-708d-4566-b740-d925d9987684 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:20.883743 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-14255e10-708d-4566-b740-d925d9987684 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:20.884171 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-14255e10-708d-4566-b740-d925d9987684 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:20.912221 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-14255e10-708d-4566-b740-d925d9987684 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041961 Jun 02 14:08:20.912811 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 547/1116] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:08:20 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 14:08:20.971677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c29d81ee-f97f-4cf4-9490-9daf9c3a5d60 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:20.972175 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c29d81ee-f97f-4cf4-9490-9daf9c3a5d60 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:20.978298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c29d81ee-f97f-4cf4-9490-9daf9c3a5d60 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:20.978747 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c29d81ee-f97f-4cf4-9490-9daf9c3a5d60 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:20.979509 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c29d81ee-f97f-4cf4-9490-9daf9c3a5d60 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:20.979943 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c29d81ee-f97f-4cf4-9490-9daf9c3a5d60 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:21.003667 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c29d81ee-f97f-4cf4-9490-9daf9c3a5d60 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Going to try to terminate instance {{(pid=118316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:08:21.031104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:21.367522 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3429789e-9e64-4469-9dae-dba6bb0feca3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:21.368120 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3429789e-9e64-4469-9dae-dba6bb0feca3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6d778df4-cdc9-440b-acda-4b10357cb31f] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:21.374285 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3429789e-9e64-4469-9dae-dba6bb0feca3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:21.374792 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3429789e-9e64-4469-9dae-dba6bb0feca3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:21.375536 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3429789e-9e64-4469-9dae-dba6bb0feca3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:21.375967 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3429789e-9e64-4469-9dae-dba6bb0feca3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:21.390025 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-3429789e-9e64-4469-9dae-dba6bb0feca3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] HTTP exception thrown: Instance 6d778df4-cdc9-440b-acda-4b10357cb31f could not be found. Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3429789e-9e64-4469-9dae-dba6bb0feca3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Request method failure captured: Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f HTTP/1.1 Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMF5gKYp9MMUFShZJvK8HWskj9c8oo7jw4xQHHv76ViSQZdjAaCopsHmNg9Z6OlkZCBQnmUJyI1SOwkTMxzwheYZ0C-B6ggUiF5fmge5TxytZPk01P0tct8Tp6fYqDzP4loJskleQvKj6QFPBiOoAalNEK-boGqHEgSQ0NKEALPF9pU Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: b55a34a53b2740d9af5efd660424a456 Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-TestVolumeBootPattern-587815091 Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:08:21.391662 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:08:21.393478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b55a34a53b2740d9af5efd660424a456"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:08:21.393478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-TestVolumeBootPattern-587815091 Jun 02 14:08:21.393478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: b55a34a53b2740d9af5efd660424a456 Jun 02 14:08:21.393478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-TestVolumeBootPattern-587815091 Jun 02 14:08:21.393478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-TestVolumeBootPattern-587815091-project Jun 02 14:08:21.393478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:08:21.393478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:08:21.393478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 315c0d9d9a284389ae07bf898c330605 Jun 02 14:08:21.393478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-TestVolumeBootPattern-587815091-project Jun 02 14:08:21.393478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:08:21.393478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance 6d778df4-cdc9-440b-acda-4b10357cb31f could not be found. Jun 02 14:08:21.393478 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '6d778df4-cdc9-440b-acda-4b10357cb31f'} Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d778df4-cdc9-440b-acda-4b10357cb31f could not be found. Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:08:21.394440 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d778df4-cdc9-440b-acda-4b10357cb31f could not be found. Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d778df4-cdc9-440b-acda-4b10357cb31f could not be found. Jun 02 14:08:21.396127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:21.397593 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3429789e-9e64-4469-9dae-dba6bb0feca3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Returning 404 to user: Instance 6d778df4-cdc9-440b-acda-4b10357cb31f could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:08:21.397593 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3429789e-9e64-4469-9dae-dba6bb0feca3 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f" status: 404 len: 111 microversion: 2.1 time: 0.030212 Jun 02 14:08:21.397593 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 548/1117] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:21 2022] GET /compute/v2.1/servers/6d778df4-cdc9-440b-acda-4b10357cb31f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 14:08:21.422916 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c29d81ee-f97f-4cf4-9490-9daf9c3a5d60 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 204 len: 0 microversion: 2.1 time: 0.454829 Jun 02 14:08:21.423726 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 570/1118] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:08:20 2022] DELETE /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:08:21.432701 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a733018c-8bd9-4af4-a53d-add77ff30efd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:21.441330 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a733018c-8bd9-4af4-a53d-add77ff30efd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:21.441330 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a733018c-8bd9-4af4-a53d-add77ff30efd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:21.441330 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a733018c-8bd9-4af4-a53d-add77ff30efd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:21.441760 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a733018c-8bd9-4af4-a53d-add77ff30efd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:21.442059 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a733018c-8bd9-4af4-a53d-add77ff30efd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:21.575678 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-a733018c-8bd9-4af4-a53d-add77ff30efd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:21.583622 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a733018c-8bd9-4af4-a53d-add77ff30efd tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1679 microversion: 2.1 time: 0.155540 Jun 02 14:08:21.584191 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 549/1119] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:21 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:22.151731 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-10d5c719-47a9-46ad-af44-be111cfabb2b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:22.152387 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-10d5c719-47a9-46ad-af44-be111cfabb2b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:22.158403 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-10d5c719-47a9-46ad-af44-be111cfabb2b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:22.158850 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-10d5c719-47a9-46ad-af44-be111cfabb2b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:22.159588 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-10d5c719-47a9-46ad-af44-be111cfabb2b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:22.160053 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-10d5c719-47a9-46ad-af44-be111cfabb2b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:22.174027 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-10d5c719-47a9-46ad-af44-be111cfabb2b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] HTTP exception thrown: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-10d5c719-47a9-46ad-af44-be111cfabb2b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Request method failure captured: Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: DELETE /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca HTTP/1.1 Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMF5gKYp9MMUFShZJvK8HWskj9c8oo7jw4xQHHv76ViSQZdjAaCopsHmNg9Z6OlkZCBQnmUJyI1SOwkTMxzwheYZ0C-B6ggUiF5fmge5TxytZPk01P0tct8Tp6fYqDzP4loJskleQvKj6QFPBiOoAalNEK-boGqHEgSQ0NKEALPF9pU Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: b55a34a53b2740d9af5efd660424a456 Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-TestVolumeBootPattern-587815091 Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:08:22.175715 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:08:22.177445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b55a34a53b2740d9af5efd660424a456"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:08:22.177445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-TestVolumeBootPattern-587815091 Jun 02 14:08:22.177445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: b55a34a53b2740d9af5efd660424a456 Jun 02 14:08:22.177445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-TestVolumeBootPattern-587815091 Jun 02 14:08:22.177445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-TestVolumeBootPattern-587815091-project Jun 02 14:08:22.177445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:08:22.177445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:08:22.177445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 315c0d9d9a284389ae07bf898c330605 Jun 02 14:08:22.177445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-TestVolumeBootPattern-587815091-project Jun 02 14:08:22.177445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:08:22.177445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:08:22.177445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': '6ff8b777-591b-48fc-8e08-8722d8a3adca'} Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:08:22.178517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:08:22.180381 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:22.182628 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-10d5c719-47a9-46ad-af44-be111cfabb2b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Returning 404 to user: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:08:22.182628 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-10d5c719-47a9-46ad-af44-be111cfabb2b tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 404 len: 111 microversion: 2.1 time: 0.030337 Jun 02 14:08:22.182628 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 571/1120] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:08:22 2022] DELETE /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:08:22.185867 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7a1b32b6-8d86-42a4-a4c6-5b3202e1d215 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:22.186509 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7a1b32b6-8d86-42a4-a4c6-5b3202e1d215 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] [instance: 6ff8b777-591b-48fc-8e08-8722d8a3adca] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:22.193375 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7a1b32b6-8d86-42a4-a4c6-5b3202e1d215 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:22.193826 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7a1b32b6-8d86-42a4-a4c6-5b3202e1d215 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:22.194592 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7a1b32b6-8d86-42a4-a4c6-5b3202e1d215 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:22.196073 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7a1b32b6-8d86-42a4-a4c6-5b3202e1d215 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:22.209213 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-7a1b32b6-8d86-42a4-a4c6-5b3202e1d215 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] HTTP exception thrown: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7a1b32b6-8d86-42a4-a4c6-5b3202e1d215 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Request method failure captured: Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca HTTP/1.1 Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMF5gKYp9MMUFShZJvK8HWskj9c8oo7jw4xQHHv76ViSQZdjAaCopsHmNg9Z6OlkZCBQnmUJyI1SOwkTMxzwheYZ0C-B6ggUiF5fmge5TxytZPk01P0tct8Tp6fYqDzP4loJskleQvKj6QFPBiOoAalNEK-boGqHEgSQ0NKEALPF9pU Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: b55a34a53b2740d9af5efd660424a456 Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-TestVolumeBootPattern-587815091 Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:08:22.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:08:22.213623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b55a34a53b2740d9af5efd660424a456"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b55a34a53b2740d9af5efd660424a456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:08:22.213623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-TestVolumeBootPattern-587815091 Jun 02 14:08:22.213623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: b55a34a53b2740d9af5efd660424a456 Jun 02 14:08:22.213623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-TestVolumeBootPattern-587815091 Jun 02 14:08:22.213623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-TestVolumeBootPattern-587815091-project Jun 02 14:08:22.213623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:08:22.213623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:08:22.213623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 315c0d9d9a284389ae07bf898c330605 Jun 02 14:08:22.213623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-TestVolumeBootPattern-587815091-project Jun 02 14:08:22.213623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:08:22.213623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:08:22.213623 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '6ff8b777-591b-48fc-8e08-8722d8a3adca'} Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:08:22.214631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. Jun 02 14:08:22.216121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:22.217615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7a1b32b6-8d86-42a4-a4c6-5b3202e1d215 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Returning 404 to user: Instance 6ff8b777-591b-48fc-8e08-8722d8a3adca could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:08:22.217615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7a1b32b6-8d86-42a4-a4c6-5b3202e1d215 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca" status: 404 len: 111 microversion: 2.1 time: 0.031330 Jun 02 14:08:22.217615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 550/1121] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:22 2022] GET /compute/v2.1/servers/6ff8b777-591b-48fc-8e08-8722d8a3adca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:08:22.601580 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-293d670d-dfda-4298-82cd-01c77ca47d8e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:22.602191 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-293d670d-dfda-4298-82cd-01c77ca47d8e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:22.608593 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-293d670d-dfda-4298-82cd-01c77ca47d8e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:22.608980 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-293d670d-dfda-4298-82cd-01c77ca47d8e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:22.609727 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-293d670d-dfda-4298-82cd-01c77ca47d8e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:22.610153 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-293d670d-dfda-4298-82cd-01c77ca47d8e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:22.742475 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-293d670d-dfda-4298-82cd-01c77ca47d8e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:22.750099 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-293d670d-dfda-4298-82cd-01c77ca47d8e tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1679 microversion: 2.1 time: 0.152372 Jun 02 14:08:22.750664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 572/1122] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:22 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:08:23.768048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0d481a45-0844-46c5-aaaa-51199a16947a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:23.768694 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0d481a45-0844-46c5-aaaa-51199a16947a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:23.778622 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0d481a45-0844-46c5-aaaa-51199a16947a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:23.778622 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0d481a45-0844-46c5-aaaa-51199a16947a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:23.778622 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0d481a45-0844-46c5-aaaa-51199a16947a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:23.778622 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0d481a45-0844-46c5-aaaa-51199a16947a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:23.783991 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5ac9dfff-2c41-4213-b45e-6f92b155a8b5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] Calling method '.version_select at 0x7fb72417bca0>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:23.881558 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5ac9dfff-2c41-4213-b45e-6f92b155a8b5 tempest-TestVolumeBootPattern-587815091 tempest-TestVolumeBootPattern-587815091-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1891088145" status: 202 len: 0 microversion: 2.1 time: 0.101198 Jun 02 14:08:23.884040 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 573/1123] 10.222.0.33 () {58 vars in 1262 bytes} [Thu Jun 2 14:08:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1891088145 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:08:23.964525 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0d481a45-0844-46c5-aaaa-51199a16947a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:23.973123 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0d481a45-0844-46c5-aaaa-51199a16947a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1679 microversion: 2.1 time: 0.208821 Jun 02 14:08:23.973710 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 551/1124] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:23 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:24.889962 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-56ad61d8-3f74-4be0-9d75-bc886d7bc0ee req-92b4f725-ba17-49b7-b5c0-0f70c59c9373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902069a0-6b09-40fd-b5b9-23530be90d8a", "name": "network-vif-deleted", "tag": "7ffd522e-fd78-4776-9eaa-a163afff7dfe"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:08:24.911297 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-56ad61d8-3f74-4be0-9d75-bc886d7bc0ee req-92b4f725-ba17-49b7-b5c0-0f70c59c9373 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:24.912030 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-56ad61d8-3f74-4be0-9d75-bc886d7bc0ee req-92b4f725-ba17-49b7-b5c0-0f70c59c9373 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:24.936233 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-56ad61d8-3f74-4be0-9d75-bc886d7bc0ee req-92b4f725-ba17-49b7-b5c0-0f70c59c9373 service nova] Creating event network-vif-deleted:7ffd522e-fd78-4776-9eaa-a163afff7dfe for instance 902069a0-6b09-40fd-b5b9-23530be90d8a on hv-cinder-82651 Jun 02 14:08:24.949026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-56ad61d8-3f74-4be0-9d75-bc886d7bc0ee req-92b4f725-ba17-49b7-b5c0-0f70c59c9373 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064309 Jun 02 14:08:24.950213 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 574/1125] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:08:24.992242 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7fb1506d-e147-4270-bf40-06fcfd58e3a9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:24.993667 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7fb1506d-e147-4270-bf40-06fcfd58e3a9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:25.008104 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7fb1506d-e147-4270-bf40-06fcfd58e3a9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:25.009065 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7fb1506d-e147-4270-bf40-06fcfd58e3a9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:25.011320 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7fb1506d-e147-4270-bf40-06fcfd58e3a9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:25.012970 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7fb1506d-e147-4270-bf40-06fcfd58e3a9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:25.147945 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7fb1506d-e147-4270-bf40-06fcfd58e3a9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:25.153400 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:25.160499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7fb1506d-e147-4270-bf40-06fcfd58e3a9 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1611 microversion: 2.1 time: 0.171721 Jun 02 14:08:25.160499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 552/1126] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:24 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1611 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:26.177066 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-eef389f4-9e31-43ad-aa58-6ab010cddb83 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:26.185903 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-eef389f4-9e31-43ad-aa58-6ab010cddb83 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:26.187227 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eef389f4-9e31-43ad-aa58-6ab010cddb83 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:26.187745 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eef389f4-9e31-43ad-aa58-6ab010cddb83 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:26.188537 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eef389f4-9e31-43ad-aa58-6ab010cddb83 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:26.189011 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eef389f4-9e31-43ad-aa58-6ab010cddb83 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:26.234571 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eef389f4-9e31-43ad-aa58-6ab010cddb83 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:26.235379 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eef389f4-9e31-43ad-aa58-6ab010cddb83 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:26.236003 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-eef389f4-9e31-43ad-aa58-6ab010cddb83 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lazy-loading 'fault' on Instance uuid 902069a0-6b09-40fd-b5b9-23530be90d8a {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:08:26.289482 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-eef389f4-9e31-43ad-aa58-6ab010cddb83 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d05eeb8ac146969b99d33084f1664c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f72940f7df74b898595c0ed9c654502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:26.297633 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-eef389f4-9e31-43ad-aa58-6ab010cddb83 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 200 len: 1330 microversion: 2.1 time: 0.124699 Jun 02 14:08:26.301489 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 575/1127] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:26 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 1330 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:27.316143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c2072072-d3dc-4fa1-b14d-73b57d8458b4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:27.316780 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c2072072-d3dc-4fa1-b14d-73b57d8458b4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:27.324376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c2072072-d3dc-4fa1-b14d-73b57d8458b4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:27.324845 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c2072072-d3dc-4fa1-b14d-73b57d8458b4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:27.325605 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c2072072-d3dc-4fa1-b14d-73b57d8458b4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:27.326063 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c2072072-d3dc-4fa1-b14d-73b57d8458b4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:27.340218 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-c2072072-d3dc-4fa1-b14d-73b57d8458b4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] HTTP exception thrown: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c2072072-d3dc-4fa1-b14d-73b57d8458b4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Request method failure captured: Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a HTTP/1.1 Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMFy_PkjCh8nju-jA0VaYoRe27Sdij_PJ-vL-9HGf9m-cRULoAY2MzvH3r9nOTiF2_SNa0DGTaap7M-J4JHAJNrDHS-wszymM6zEqEWgK8stKwPY-XOb5tLiYFnXd51Ue2ODNQOEzPNwMcb1Mm2IHy1m8FAhNZxug520YoLsr6cRsBI Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:08:27.341785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:08:27.343468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f72940f7df74b898595c0ed9c654502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:08:27.343468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:27.343468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:27.343468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:27.343468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:27.343468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:08:27.343468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:08:27.343468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: b8d05eeb8ac146969b99d33084f1664c Jun 02 14:08:27.343468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:27.343468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:08:27.343468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:27.343468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '902069a0-6b09-40fd-b5b9-23530be90d8a'} Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:08:27.344556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:27.346086 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:27.347529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c2072072-d3dc-4fa1-b14d-73b57d8458b4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Returning 404 to user: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:08:27.347529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c2072072-d3dc-4fa1-b14d-73b57d8458b4 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 404 len: 111 microversion: 2.1 time: 0.031323 Jun 02 14:08:27.347529 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 553/1128] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:27 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:08:27.352667 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b3409a85-d32c-435d-9aa8-d63cd2ed0034 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '.version_select at 0x7fb72417b670>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:27.481174 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b3409a85-d32c-435d-9aa8-d63cd2ed0034 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-394136858" status: 202 len: 0 microversion: 2.1 time: 0.132820 Jun 02 14:08:27.487082 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 576/1129] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 2 14:08:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-394136858 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:08:29.774259 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-884aab51-148d-485a-b0e0-2cec11b414da tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:29.775480 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-884aab51-148d-485a-b0e0-2cec11b414da tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:29.783653 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-884aab51-148d-485a-b0e0-2cec11b414da tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:29.783653 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-884aab51-148d-485a-b0e0-2cec11b414da tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:29.784451 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-884aab51-148d-485a-b0e0-2cec11b414da tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:29.784886 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-884aab51-148d-485a-b0e0-2cec11b414da tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:29.789832 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-239165379", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "networks": [{"uuid": "72085b90-9d86-4bc8-9080-4b69c4bc992d"}]}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:08:29.799873 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-884aab51-148d-485a-b0e0-2cec11b414da tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] HTTP exception thrown: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-884aab51-148d-485a-b0e0-2cec11b414da tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Request method failure captured: Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: DELETE /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a HTTP/1.1 Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMFy_PkjCh8nju-jA0VaYoRe27Sdij_PJ-vL-9HGf9m-cRULoAY2MzvH3r9nOTiF2_SNa0DGTaap7M-J4JHAJNrDHS-wszymM6zEqEWgK8stKwPY-XOb5tLiYFnXd51Ue2ODNQOEzPNwMcb1Mm2IHy1m8FAhNZxug520YoLsr6cRsBI Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:08:29.801472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:08:29.803930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f72940f7df74b898595c0ed9c654502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:08:29.803930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:29.803930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:29.803930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:29.803930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:29.803930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:08:29.803930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:08:29.803930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: b8d05eeb8ac146969b99d33084f1664c Jun 02 14:08:29.803930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:29.803930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:08:29.803930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:29.803930 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '902069a0-6b09-40fd-b5b9-23530be90d8a'} Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:08:29.805685 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:29.808131 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:29.810403 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-884aab51-148d-485a-b0e0-2cec11b414da tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Returning 404 to user: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:08:29.810403 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-884aab51-148d-485a-b0e0-2cec11b414da tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 404 len: 111 microversion: 2.1 time: 0.034087 Jun 02 14:08:29.810403 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 554/1130] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:08:29 2022] DELETE /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:08:29.813953 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-199b167a-5446-4995-b8b8-a63060c6521a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:29.814611 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-199b167a-5446-4995-b8b8-a63060c6521a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: 902069a0-6b09-40fd-b5b9-23530be90d8a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:29.822862 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-199b167a-5446-4995-b8b8-a63060c6521a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:29.823296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-199b167a-5446-4995-b8b8-a63060c6521a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:29.824260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-199b167a-5446-4995-b8b8-a63060c6521a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:29.824894 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-199b167a-5446-4995-b8b8-a63060c6521a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:29.844181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-199b167a-5446-4995-b8b8-a63060c6521a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] HTTP exception thrown: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-199b167a-5446-4995-b8b8-a63060c6521a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Request method failure captured: Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a HTTP/1.1 Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMFy_PkjCh8nju-jA0VaYoRe27Sdij_PJ-vL-9HGf9m-cRULoAY2MzvH3r9nOTiF2_SNa0DGTaap7M-J4JHAJNrDHS-wszymM6zEqEWgK8stKwPY-XOb5tLiYFnXd51Ue2ODNQOEzPNwMcb1Mm2IHy1m8FAhNZxug520YoLsr6cRsBI Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:08:29.845190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:08:29.847807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f72940f7df74b898595c0ed9c654502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:08:29.847807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:29.847807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:29.847807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:29.847807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:29.847807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:08:29.847807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:08:29.847807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: b8d05eeb8ac146969b99d33084f1664c Jun 02 14:08:29.847807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:29.847807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:08:29.847807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:29.847807 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '902069a0-6b09-40fd-b5b9-23530be90d8a'} Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:08:29.848726 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. Jun 02 14:08:29.849968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:29.853342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-199b167a-5446-4995-b8b8-a63060c6521a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Returning 404 to user: Instance 902069a0-6b09-40fd-b5b9-23530be90d8a could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:08:29.853603 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.network.neutron [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] validate_networks() for [('72085b90-9d86-4bc8-9080-4b69c4bc992d', None, None, None, None, None)] {{(pid=118316) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 14:08:29.853710 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-199b167a-5446-4995-b8b8-a63060c6521a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a" status: 404 len: 111 microversion: 2.1 time: 0.039436 Jun 02 14:08:29.853710 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 555/1131] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:29 2022] GET /compute/v2.1/servers/902069a0-6b09-40fd-b5b9-23530be90d8a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:08:30.334048 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Flavor limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 14:08:30.334503 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Image limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 14:08:30.336142 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Flavor pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 14:08:30.336779 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Image pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 14:08:30.337481 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 14:08:30.347574 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:30.348024 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:30.348898 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:30.349542 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:30.367975 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Getting quotas for project 48bc1d636aba41d1a3534c56e3a4ccda. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:08:30.372437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Getting quotas for user 36ce0ba640c045118116e1b68c4f3e63 and project 48bc1d636aba41d1a3534c56e3a4ccda. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:08:30.384195 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Going to run 1 instances... {{(pid=118316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 14:08:30.386097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 14:08:30.522282 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-38f89fe4-da1f-4fa0-a561-373a9024e204 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736543 Jun 02 14:08:30.528421 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 577/1132] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 14:08:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 14:08:30.533351 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2edbabb5-c230-4133-a843-bd9847c06fdf tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:30.534252 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-2edbabb5-c230-4133-a843-bd9847c06fdf tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:30.607410 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-2edbabb5-c230-4133-a843-bd9847c06fdf tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:30.614913 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2edbabb5-c230-4133-a843-bd9847c06fdf tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1218 microversion: 2.1 time: 0.085401 Jun 02 14:08:30.615455 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 556/1133] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:30 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:08:31.176831 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-aeee6c07-3edb-4bb2-951f-20033ac0b775 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:31.177374 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-aeee6c07-3edb-4bb2-951f-20033ac0b775 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:31.184160 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:31.188095 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aeee6c07-3edb-4bb2-951f-20033ac0b775 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:31.188565 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aeee6c07-3edb-4bb2-951f-20033ac0b775 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:31.189324 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aeee6c07-3edb-4bb2-951f-20033ac0b775 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:31.189967 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-aeee6c07-3edb-4bb2-951f-20033ac0b775 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:31.206941 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-aeee6c07-3edb-4bb2-951f-20033ac0b775 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] HTTP exception thrown: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-aeee6c07-3edb-4bb2-951f-20033ac0b775 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Request method failure captured: Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: DELETE /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 HTTP/1.1 Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMFy_PkjCh8nju-jA0VaYoRe27Sdij_PJ-vL-9HGf9m-cRULoAY2MzvH3r9nOTiF2_SNa0DGTaap7M-J4JHAJNrDHS-wszymM6zEqEWgK8stKwPY-XOb5tLiYFnXd51Ue2ODNQOEzPNwMcb1Mm2IHy1m8FAhNZxug520YoLsr6cRsBI Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:08:31.209497 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:08:31.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f72940f7df74b898595c0ed9c654502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:08:31.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:31.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:31.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:31.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:31.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:08:31.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:08:31.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: b8d05eeb8ac146969b99d33084f1664c Jun 02 14:08:31.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:31.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:08:31.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:08:31.211926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': 'a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6'} Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:08:31.212781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:08:31.214253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.215602 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-aeee6c07-3edb-4bb2-951f-20033ac0b775 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Returning 404 to user: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:08:31.215602 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-aeee6c07-3edb-4bb2-951f-20033ac0b775 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 404 len: 111 microversion: 2.1 time: 0.041439 Jun 02 14:08:31.216352 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 578/1134] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:08:31 2022] DELETE /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:08:31.221212 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-de416a06-95d0-46a0-b730-1468e52de2a8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:31.221794 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-de416a06-95d0-46a0-b730-1468e52de2a8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:31.229364 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-de416a06-95d0-46a0-b730-1468e52de2a8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:31.229806 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-de416a06-95d0-46a0-b730-1468e52de2a8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:31.230567 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-de416a06-95d0-46a0-b730-1468e52de2a8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:31.235380 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-de416a06-95d0-46a0-b730-1468e52de2a8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:31.244415 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-de416a06-95d0-46a0-b730-1468e52de2a8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] HTTP exception thrown: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-de416a06-95d0-46a0-b730-1468e52de2a8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Request method failure captured: Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 HTTP/1.1 Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMFy_PkjCh8nju-jA0VaYoRe27Sdij_PJ-vL-9HGf9m-cRULoAY2MzvH3r9nOTiF2_SNa0DGTaap7M-J4JHAJNrDHS-wszymM6zEqEWgK8stKwPY-XOb5tLiYFnXd51Ue2ODNQOEzPNwMcb1Mm2IHy1m8FAhNZxug520YoLsr6cRsBI Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:08:31.246048 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:08:31.247785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f72940f7df74b898595c0ed9c654502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:08:31.247785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:31.247785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:31.247785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:31.247785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:31.247785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:08:31.247785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:08:31.247785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: b8d05eeb8ac146969b99d33084f1664c Jun 02 14:08:31.247785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:31.247785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:08:31.247785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:08:31.247785 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': 'a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6'} Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:08:31.248613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. Jun 02 14:08:31.250244 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.251632 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-de416a06-95d0-46a0-b730-1468e52de2a8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Returning 404 to user: Instance a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:08:31.251632 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-de416a06-95d0-46a0-b730-1468e52de2a8 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6" status: 404 len: 111 microversion: 2.1 time: 0.031000 Jun 02 14:08:31.251632 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 557/1135] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:31 2022] GET /compute/v2.1/servers/a4b80a53-eb3b-4eb8-b7c1-7245097cb5e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 14:08:31.258342 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ee15ae3e-375e-4a8c-8da3-bb82608c5b46 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:31.259047 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ee15ae3e-375e-4a8c-8da3-bb82608c5b46 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:31.265236 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ee15ae3e-375e-4a8c-8da3-bb82608c5b46 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:31.270344 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ee15ae3e-375e-4a8c-8da3-bb82608c5b46 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:31.271170 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ee15ae3e-375e-4a8c-8da3-bb82608c5b46 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:31.271684 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ee15ae3e-375e-4a8c-8da3-bb82608c5b46 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:31.287134 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-ee15ae3e-375e-4a8c-8da3-bb82608c5b46 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] HTTP exception thrown: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ee15ae3e-375e-4a8c-8da3-bb82608c5b46 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Request method failure captured: Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: DELETE /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 HTTP/1.1 Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMFy_PkjCh8nju-jA0VaYoRe27Sdij_PJ-vL-9HGf9m-cRULoAY2MzvH3r9nOTiF2_SNa0DGTaap7M-J4JHAJNrDHS-wszymM6zEqEWgK8stKwPY-XOb5tLiYFnXd51Ue2ODNQOEzPNwMcb1Mm2IHy1m8FAhNZxug520YoLsr6cRsBI Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:08:31.288708 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:08:31.290388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f72940f7df74b898595c0ed9c654502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:08:31.290388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:31.290388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:31.290388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:31.290388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:31.290388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:08:31.290388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:08:31.290388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: b8d05eeb8ac146969b99d33084f1664c Jun 02 14:08:31.290388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:31.290388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:08:31.290388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:08:31.290388 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': 'f6d1d51b-029d-43f1-ba8b-15f5ce6211e2'} Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:08:31.291308 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:08:31.292880 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.295043 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ee15ae3e-375e-4a8c-8da3-bb82608c5b46 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Returning 404 to user: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:08:31.295043 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ee15ae3e-375e-4a8c-8da3-bb82608c5b46 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 404 len: 111 microversion: 2.1 time: 0.036524 Jun 02 14:08:31.295043 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 579/1136] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:08:31 2022] DELETE /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:08:31.298544 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-be73efd0-779f-43f5-a60d-9b06b30c6921 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:31.299180 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-be73efd0-779f-43f5-a60d-9b06b30c6921 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: f6d1d51b-029d-43f1-ba8b-15f5ce6211e2] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:31.301020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=51 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:31.305873 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-be73efd0-779f-43f5-a60d-9b06b30c6921 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:31.306318 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-be73efd0-779f-43f5-a60d-9b06b30c6921 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:31.310214 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-be73efd0-779f-43f5-a60d-9b06b30c6921 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:31.310214 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-be73efd0-779f-43f5-a60d-9b06b30c6921 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:31.323380 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-be73efd0-779f-43f5-a60d-9b06b30c6921 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] HTTP exception thrown: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-be73efd0-779f-43f5-a60d-9b06b30c6921 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Request method failure captured: Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 HTTP/1.1 Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMFy_PkjCh8nju-jA0VaYoRe27Sdij_PJ-vL-9HGf9m-cRULoAY2MzvH3r9nOTiF2_SNa0DGTaap7M-J4JHAJNrDHS-wszymM6zEqEWgK8stKwPY-XOb5tLiYFnXd51Ue2ODNQOEzPNwMcb1Mm2IHy1m8FAhNZxug520YoLsr6cRsBI Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:08:31.324962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:08:31.326607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f72940f7df74b898595c0ed9c654502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:08:31.326607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:31.326607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:31.326607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:31.326607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:31.326607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:08:31.326607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:08:31.326607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: b8d05eeb8ac146969b99d33084f1664c Jun 02 14:08:31.326607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:31.326607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:08:31.326607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:08:31.326607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': 'f6d1d51b-029d-43f1-ba8b-15f5ce6211e2'} Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:08:31.327612 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. Jun 02 14:08:31.329293 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:08:31.330654 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-be73efd0-779f-43f5-a60d-9b06b30c6921 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Returning 404 to user: Instance f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:08:31.330654 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-be73efd0-779f-43f5-a60d-9b06b30c6921 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2" status: 404 len: 111 microversion: 2.1 time: 0.031662 Jun 02 14:08:31.332486 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 558/1137] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:31 2022] GET /compute/v2.1/servers/f6d1d51b-029d-43f1-ba8b-15f5ce6211e2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:08:31.633293 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4812eec1-c55d-4582-a6db-977e30ccee95 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:31.633700 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4812eec1-c55d-4582-a6db-977e30ccee95 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:31.713282 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4812eec1-c55d-4582-a6db-977e30ccee95 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:31.722091 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4812eec1-c55d-4582-a6db-977e30ccee95 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1218 microversion: 2.1 time: 0.092331 Jun 02 14:08:31.732603 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 580/1138] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:31 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:32.739801 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c49624cd-f870-42ec-a217-c18c04219fc0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:32.740481 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c49624cd-f870-42ec-a217-c18c04219fc0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:32.747499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c49624cd-f870-42ec-a217-c18c04219fc0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:32.747936 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c49624cd-f870-42ec-a217-c18c04219fc0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:32.748724 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c49624cd-f870-42ec-a217-c18c04219fc0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:32.749152 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c49624cd-f870-42ec-a217-c18c04219fc0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:32.776656 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c9e12033-e104-4316-8463-753e744f0759 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:32.778400 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c9e12033-e104-4316-8463-753e744f0759 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:32.789952 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c9e12033-e104-4316-8463-753e744f0759 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:32.790403 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c9e12033-e104-4316-8463-753e744f0759 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:32.792773 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c9e12033-e104-4316-8463-753e744f0759 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:32.793223 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c9e12033-e104-4316-8463-753e744f0759 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:32.807969 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-c9e12033-e104-4316-8463-753e744f0759 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] HTTP exception thrown: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c9e12033-e104-4316-8463-753e744f0759 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Request method failure captured: Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: DELETE /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f HTTP/1.1 Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMFy_PkjCh8nju-jA0VaYoRe27Sdij_PJ-vL-9HGf9m-cRULoAY2MzvH3r9nOTiF2_SNa0DGTaap7M-J4JHAJNrDHS-wszymM6zEqEWgK8stKwPY-XOb5tLiYFnXd51Ue2ODNQOEzPNwMcb1Mm2IHy1m8FAhNZxug520YoLsr6cRsBI Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:08:32.809568 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:08:32.810944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f72940f7df74b898595c0ed9c654502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:08:32.810944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:32.810944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:32.810944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:32.810944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:32.810944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:08:32.810944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:08:32.810944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: b8d05eeb8ac146969b99d33084f1664c Jun 02 14:08:32.810944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:32.810944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:08:32.810944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:08:32.810944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': 'c4ee5a26-ff9a-4c58-98a4-2664248a553f'} Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:08:32.811717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:08:32.813369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:32.815902 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c9e12033-e104-4316-8463-753e744f0759 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Returning 404 to user: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:08:32.815902 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c9e12033-e104-4316-8463-753e744f0759 tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 404 len: 111 microversion: 2.1 time: 0.038492 Jun 02 14:08:32.815902 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 581/1139] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:08:32 2022] DELETE /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 14:08:32.816191 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c49624cd-f870-42ec-a217-c18c04219fc0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:32.821184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6b18ab94-d36f-40d1-910e-7ad56c7f1c5a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:32.821991 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6b18ab94-d36f-40d1-910e-7ad56c7f1c5a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] [instance: c4ee5a26-ff9a-4c58-98a4-2664248a553f] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:32.823971 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c49624cd-f870-42ec-a217-c18c04219fc0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1214 microversion: 2.1 time: 0.088362 Jun 02 14:08:32.824563 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 559/1140] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:32 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:08:32.834463 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6b18ab94-d36f-40d1-910e-7ad56c7f1c5a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:32.834907 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6b18ab94-d36f-40d1-910e-7ad56c7f1c5a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:32.836216 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6b18ab94-d36f-40d1-910e-7ad56c7f1c5a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:32.836679 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6b18ab94-d36f-40d1-910e-7ad56c7f1c5a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:32.850038 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-6b18ab94-d36f-40d1-910e-7ad56c7f1c5a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] HTTP exception thrown: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6b18ab94-d36f-40d1-910e-7ad56c7f1c5a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Request method failure captured: Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f HTTP/1.1 Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMFy_PkjCh8nju-jA0VaYoRe27Sdij_PJ-vL-9HGf9m-cRULoAY2MzvH3r9nOTiF2_SNa0DGTaap7M-J4JHAJNrDHS-wszymM6zEqEWgK8stKwPY-XOb5tLiYFnXd51Ue2ODNQOEzPNwMcb1Mm2IHy1m8FAhNZxug520YoLsr6cRsBI Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:08:32.852652 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:08:32.854304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f72940f7df74b898595c0ed9c654502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f72940f7df74b898595c0ed9c654502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:08:32.854304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:32.854304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 8f72940f7df74b898595c0ed9c654502 Jun 02 14:08:32.854304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1621758936 Jun 02 14:08:32.854304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:32.854304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:08:32.854304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:08:32.854304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: b8d05eeb8ac146969b99d33084f1664c Jun 02 14:08:32.854304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-AttachVolumeNegativeTest-1621758936-project Jun 02 14:08:32.854304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:08:32.854304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:08:32.854304 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': 'c4ee5a26-ff9a-4c58-98a4-2664248a553f'} Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:08:32.855285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. Jun 02 14:08:32.856888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:08:32.858234 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6b18ab94-d36f-40d1-910e-7ad56c7f1c5a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] Returning 404 to user: Instance c4ee5a26-ff9a-4c58-98a4-2664248a553f could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:08:32.858234 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6b18ab94-d36f-40d1-910e-7ad56c7f1c5a tempest-AttachVolumeNegativeTest-1621758936 tempest-AttachVolumeNegativeTest-1621758936-project] 10.222.0.33 "GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f" status: 404 len: 111 microversion: 2.1 time: 0.037969 Jun 02 14:08:32.858234 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 582/1141] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:32 2022] GET /compute/v2.1/servers/c4ee5a26-ff9a-4c58-98a4-2664248a553f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:08:33.841690 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4f281cb5-d474-47ac-a6c4-8cbc6647dd32 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:33.842321 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4f281cb5-d474-47ac-a6c4-8cbc6647dd32 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:33.848915 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4f281cb5-d474-47ac-a6c4-8cbc6647dd32 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:33.849363 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4f281cb5-d474-47ac-a6c4-8cbc6647dd32 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:33.850130 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4f281cb5-d474-47ac-a6c4-8cbc6647dd32 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:33.850568 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4f281cb5-d474-47ac-a6c4-8cbc6647dd32 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:33.975436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4f281cb5-d474-47ac-a6c4-8cbc6647dd32 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:33.984468 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4f281cb5-d474-47ac-a6c4-8cbc6647dd32 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1278 microversion: 2.1 time: 0.146715 Jun 02 14:08:33.985707 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 560/1142] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:33 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:08:35.002773 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-118dfdb9-221c-4488-afa7-e53bad46f99d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:35.003350 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-118dfdb9-221c-4488-afa7-e53bad46f99d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:35.009886 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-118dfdb9-221c-4488-afa7-e53bad46f99d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:35.010691 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-118dfdb9-221c-4488-afa7-e53bad46f99d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:35.011835 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-118dfdb9-221c-4488-afa7-e53bad46f99d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:35.012450 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-118dfdb9-221c-4488-afa7-e53bad46f99d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:35.524365 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-118dfdb9-221c-4488-afa7-e53bad46f99d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:35.533664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-118dfdb9-221c-4488-afa7-e53bad46f99d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1318 microversion: 2.1 time: 0.534913 Jun 02 14:08:35.534861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 583/1143] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:34 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1318 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:36.135416 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-4a97800b-ba6d-4e1f-8307-b016bd379af3 req-38376791-ff45-479e-8e95-30c0b96b4d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afbaac83-7a31-4b52-b437-932af9997a72", "tag": "2e7167b3-6bcc-4ae3-8cdf-c53fcc3520ed"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:08:36.144707 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-4a97800b-ba6d-4e1f-8307-b016bd379af3 req-38376791-ff45-479e-8e95-30c0b96b4d8c service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:36.145512 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-4a97800b-ba6d-4e1f-8307-b016bd379af3 req-38376791-ff45-479e-8e95-30c0b96b4d8c service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:36.158339 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-4a97800b-ba6d-4e1f-8307-b016bd379af3 req-38376791-ff45-479e-8e95-30c0b96b4d8c service nova] Creating event network-changed:2e7167b3-6bcc-4ae3-8cdf-c53fcc3520ed for instance afbaac83-7a31-4b52-b437-932af9997a72 on hv-cinder-82651 Jun 02 14:08:36.165576 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-4a97800b-ba6d-4e1f-8307-b016bd379af3 req-38376791-ff45-479e-8e95-30c0b96b4d8c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036751 Jun 02 14:08:36.166190 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 561/1144] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:08:36.556738 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-16aa6eda-078f-499e-85cf-0ec591ed1edd tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:36.557369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-16aa6eda-078f-499e-85cf-0ec591ed1edd tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:36.564171 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-16aa6eda-078f-499e-85cf-0ec591ed1edd tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:36.564712 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-16aa6eda-078f-499e-85cf-0ec591ed1edd tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:36.565487 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-16aa6eda-078f-499e-85cf-0ec591ed1edd tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:36.565916 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-16aa6eda-078f-499e-85cf-0ec591ed1edd tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:36.791030 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-16aa6eda-078f-499e-85cf-0ec591ed1edd tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:36.798986 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-16aa6eda-078f-499e-85cf-0ec591ed1edd tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1318 microversion: 2.1 time: 0.248589 Jun 02 14:08:36.802442 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 584/1145] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:36 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:37.817666 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-882af572-3c95-4995-88cd-c356b33ea49c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:37.818376 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-882af572-3c95-4995-88cd-c356b33ea49c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:37.825291 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-882af572-3c95-4995-88cd-c356b33ea49c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:37.825742 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-882af572-3c95-4995-88cd-c356b33ea49c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:37.826513 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-882af572-3c95-4995-88cd-c356b33ea49c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:37.826953 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-882af572-3c95-4995-88cd-c356b33ea49c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:37.972329 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-882af572-3c95-4995-88cd-c356b33ea49c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:37.980197 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-882af572-3c95-4995-88cd-c356b33ea49c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1318 microversion: 2.1 time: 0.167084 Jun 02 14:08:37.980834 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 562/1146] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:37 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:38.996325 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9f7eb747-ce95-4edb-a0df-ab229ef03ca2 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:38.996977 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-9f7eb747-ce95-4edb-a0df-ab229ef03ca2 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:39.003389 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9f7eb747-ce95-4edb-a0df-ab229ef03ca2 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:39.003838 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9f7eb747-ce95-4edb-a0df-ab229ef03ca2 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:39.004643 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9f7eb747-ce95-4edb-a0df-ab229ef03ca2 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:39.005080 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-9f7eb747-ce95-4edb-a0df-ab229ef03ca2 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:39.139271 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-9f7eb747-ce95-4edb-a0df-ab229ef03ca2 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:39.146790 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9f7eb747-ce95-4edb-a0df-ab229ef03ca2 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1318 microversion: 2.1 time: 0.154227 Jun 02 14:08:39.147375 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 585/1147] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:38 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:40.164752 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-b33fe85c-3e4a-402d-9bcd-f2992e2a6f5b tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:40.165367 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-b33fe85c-3e4a-402d-9bcd-f2992e2a6f5b tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:40.171947 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b33fe85c-3e4a-402d-9bcd-f2992e2a6f5b tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:40.172379 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b33fe85c-3e4a-402d-9bcd-f2992e2a6f5b tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:40.173166 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b33fe85c-3e4a-402d-9bcd-f2992e2a6f5b tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:40.173603 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-b33fe85c-3e4a-402d-9bcd-f2992e2a6f5b tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:40.313484 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-b33fe85c-3e4a-402d-9bcd-f2992e2a6f5b tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:40.321857 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-b33fe85c-3e4a-402d-9bcd-f2992e2a6f5b tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1318 microversion: 2.1 time: 0.161453 Jun 02 14:08:40.322432 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 563/1148] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:40 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:08:41.338838 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-66276896-f47e-4fcc-a380-2b493ab00f00 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:41.339466 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-66276896-f47e-4fcc-a380-2b493ab00f00 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:41.341784 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:41.346677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-66276896-f47e-4fcc-a380-2b493ab00f00 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:41.347127 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-66276896-f47e-4fcc-a380-2b493ab00f00 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:41.347914 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-66276896-f47e-4fcc-a380-2b493ab00f00 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:41.348348 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-66276896-f47e-4fcc-a380-2b493ab00f00 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:41.475988 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-66276896-f47e-4fcc-a380-2b493ab00f00 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:41.483619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-66276896-f47e-4fcc-a380-2b493ab00f00 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1318 microversion: 2.1 time: 0.148631 Jun 02 14:08:41.484183 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 586/1149] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:41 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:42.399983 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-5e51b2e7-61c9-4d3e-8b65-f87980922766 req-a6350a74-b366-4eee-b1f2-dd006762cdfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afbaac83-7a31-4b52-b437-932af9997a72", "name": "network-vif-plugged", "status": "completed", "tag": "2e7167b3-6bcc-4ae3-8cdf-c53fcc3520ed"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:08:42.403778 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=2 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:42.409552 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-5e51b2e7-61c9-4d3e-8b65-f87980922766 req-a6350a74-b366-4eee-b1f2-dd006762cdfe service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:42.409996 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-5e51b2e7-61c9-4d3e-8b65-f87980922766 req-a6350a74-b366-4eee-b1f2-dd006762cdfe service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:42.422225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-5e51b2e7-61c9-4d3e-8b65-f87980922766 req-a6350a74-b366-4eee-b1f2-dd006762cdfe service nova] Creating event network-vif-plugged:2e7167b3-6bcc-4ae3-8cdf-c53fcc3520ed for instance afbaac83-7a31-4b52-b437-932af9997a72 on hv-cinder-82651 Jun 02 14:08:42.426901 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-5e51b2e7-61c9-4d3e-8b65-f87980922766 req-a6350a74-b366-4eee-b1f2-dd006762cdfe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031183 Jun 02 14:08:42.427483 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 564/1150] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:08:42.502373 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c596fad5-590b-4723-ac17-1dfc9885b98e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:42.503138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c596fad5-590b-4723-ac17-1dfc9885b98e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:42.506235 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=8 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:42.512520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c596fad5-590b-4723-ac17-1dfc9885b98e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:42.512970 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c596fad5-590b-4723-ac17-1dfc9885b98e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:42.513879 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c596fad5-590b-4723-ac17-1dfc9885b98e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:42.514765 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c596fad5-590b-4723-ac17-1dfc9885b98e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:42.658558 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c596fad5-590b-4723-ac17-1dfc9885b98e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:42.672086 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c596fad5-590b-4723-ac17-1dfc9885b98e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1318 microversion: 2.1 time: 0.174879 Jun 02 14:08:42.673113 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 587/1151] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:42 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:43.690686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-07c00050-382c-4056-a80c-f35bed39b3b9 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:43.691430 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-07c00050-382c-4056-a80c-f35bed39b3b9 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:43.698934 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-07c00050-382c-4056-a80c-f35bed39b3b9 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:43.699374 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-07c00050-382c-4056-a80c-f35bed39b3b9 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:43.700124 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-07c00050-382c-4056-a80c-f35bed39b3b9 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:43.700696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-07c00050-382c-4056-a80c-f35bed39b3b9 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:43.836200 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-07c00050-382c-4056-a80c-f35bed39b3b9 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:43.843621 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-07c00050-382c-4056-a80c-f35bed39b3b9 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1318 microversion: 2.1 time: 0.157684 Jun 02 14:08:43.844181 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 565/1152] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:43 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:08:44.859813 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-97bc9f51-5b95-43ef-b39c-9d19455eb448 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:08:44.860475 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-97bc9f51-5b95-43ef-b39c-9d19455eb448 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:08:44.867422 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-97bc9f51-5b95-43ef-b39c-9d19455eb448 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:44.867671 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-97bc9f51-5b95-43ef-b39c-9d19455eb448 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:44.868455 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-97bc9f51-5b95-43ef-b39c-9d19455eb448 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:08:44.868944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-97bc9f51-5b95-43ef-b39c-9d19455eb448 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:08:45.010396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-97bc9f51-5b95-43ef-b39c-9d19455eb448 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:08:45.018044 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-97bc9f51-5b95-43ef-b39c-9d19455eb448 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1506 microversion: 2.1 time: 0.161875 Jun 02 14:08:45.018618 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 588/1153] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:08:44 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:09.758372 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-8b06b92a-d205-45e5-8cd3-75a756d7df6f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:09.759238 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-8b06b92a-d205-45e5-8cd3-75a756d7df6f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:09.761522 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=15 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:09.762248 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=44 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:09.767098 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8b06b92a-d205-45e5-8cd3-75a756d7df6f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:09.767544 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8b06b92a-d205-45e5-8cd3-75a756d7df6f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:09.768316 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8b06b92a-d205-45e5-8cd3-75a756d7df6f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:09.768787 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8b06b92a-d205-45e5-8cd3-75a756d7df6f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:09.798494 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-8b06b92a-d205-45e5-8cd3-75a756d7df6f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044834 Jun 02 14:09:09.799062 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 566/1154] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:09:09 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 14:09:09.856881 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b93d5b58-4878-4067-b475-2deeb8d3a07a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:09.857397 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b93d5b58-4878-4067-b475-2deeb8d3a07a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:09.859525 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=23 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:09.860186 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:09.864876 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b93d5b58-4878-4067-b475-2deeb8d3a07a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:09.865323 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b93d5b58-4878-4067-b475-2deeb8d3a07a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:09.866236 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b93d5b58-4878-4067-b475-2deeb8d3a07a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:09.866675 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b93d5b58-4878-4067-b475-2deeb8d3a07a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:09.891494 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b93d5b58-4878-4067-b475-2deeb8d3a07a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Going to try to terminate instance {{(pid=118316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:09:10.624717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b93d5b58-4878-4067-b475-2deeb8d3a07a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 204 len: 0 microversion: 2.1 time: 0.771238 Jun 02 14:09:10.625229 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 589/1155] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:09:09 2022] DELETE /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 0 bytes in 773 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:09:10.634753 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1cbf9e3e-60ae-472e-9047-871961dbdcb3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:10.635372 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1cbf9e3e-60ae-472e-9047-871961dbdcb3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:10.642166 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1cbf9e3e-60ae-472e-9047-871961dbdcb3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:10.642677 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1cbf9e3e-60ae-472e-9047-871961dbdcb3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:10.643499 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1cbf9e3e-60ae-472e-9047-871961dbdcb3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:10.643936 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1cbf9e3e-60ae-472e-9047-871961dbdcb3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:10.935450 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1cbf9e3e-60ae-472e-9047-871961dbdcb3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:10.945168 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1cbf9e3e-60ae-472e-9047-871961dbdcb3 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1674 microversion: 2.1 time: 0.315272 Jun 02 14:09:10.945747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 567/1156] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:10 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1674 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:11.964231 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c6b0c4fd-b0cd-420f-bc92-19bcca1bb532 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:11.965022 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c6b0c4fd-b0cd-420f-bc92-19bcca1bb532 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:11.972119 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6b0c4fd-b0cd-420f-bc92-19bcca1bb532 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:11.972607 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6b0c4fd-b0cd-420f-bc92-19bcca1bb532 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:11.973555 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6b0c4fd-b0cd-420f-bc92-19bcca1bb532 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:11.974017 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6b0c4fd-b0cd-420f-bc92-19bcca1bb532 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:12.157184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c6b0c4fd-b0cd-420f-bc92-19bcca1bb532 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:12.164744 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c6b0c4fd-b0cd-420f-bc92-19bcca1bb532 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1674 microversion: 2.1 time: 0.206206 Jun 02 14:09:12.165337 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 590/1157] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:11 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1674 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:13.181038 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1a270796-c47e-4bed-829d-465276901d3d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:13.181602 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1a270796-c47e-4bed-829d-465276901d3d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:13.188143 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1a270796-c47e-4bed-829d-465276901d3d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:13.188648 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1a270796-c47e-4bed-829d-465276901d3d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:13.189408 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1a270796-c47e-4bed-829d-465276901d3d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:13.189839 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1a270796-c47e-4bed-829d-465276901d3d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:13.317299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1a270796-c47e-4bed-829d-465276901d3d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:13.325394 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1a270796-c47e-4bed-829d-465276901d3d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1674 microversion: 2.1 time: 0.148341 Jun 02 14:09:13.325965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 568/1158] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:13 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:14.342439 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5edbca1b-917d-442d-83d0-b563881ce37b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:14.342966 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-5edbca1b-917d-442d-83d0-b563881ce37b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:14.349426 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5edbca1b-917d-442d-83d0-b563881ce37b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:14.350675 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5edbca1b-917d-442d-83d0-b563881ce37b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:14.351434 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5edbca1b-917d-442d-83d0-b563881ce37b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:14.351863 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5edbca1b-917d-442d-83d0-b563881ce37b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:14.485080 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5edbca1b-917d-442d-83d0-b563881ce37b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:14.492752 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5edbca1b-917d-442d-83d0-b563881ce37b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1674 microversion: 2.1 time: 0.154193 Jun 02 14:09:14.493534 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 591/1159] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:14 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:15.509946 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5c6bf0fa-c9c3-44a9-b4c0-63e587502a9c tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:15.510591 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5c6bf0fa-c9c3-44a9-b4c0-63e587502a9c tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:15.517333 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5c6bf0fa-c9c3-44a9-b4c0-63e587502a9c tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:15.517778 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5c6bf0fa-c9c3-44a9-b4c0-63e587502a9c tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:15.518534 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5c6bf0fa-c9c3-44a9-b4c0-63e587502a9c tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:15.518962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5c6bf0fa-c9c3-44a9-b4c0-63e587502a9c tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:15.654444 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5c6bf0fa-c9c3-44a9-b4c0-63e587502a9c tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:15.661977 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5c6bf0fa-c9c3-44a9-b4c0-63e587502a9c tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1674 microversion: 2.1 time: 0.155984 Jun 02 14:09:15.663141 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 569/1160] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:15 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:16.680493 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-21c66223-46e4-4846-afb4-df3b111aaa26 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:16.681115 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-21c66223-46e4-4846-afb4-df3b111aaa26 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:16.687583 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21c66223-46e4-4846-afb4-df3b111aaa26 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:16.688033 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21c66223-46e4-4846-afb4-df3b111aaa26 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:16.688823 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21c66223-46e4-4846-afb4-df3b111aaa26 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:16.689259 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21c66223-46e4-4846-afb4-df3b111aaa26 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:16.822026 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-21c66223-46e4-4846-afb4-df3b111aaa26 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:16.829851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-21c66223-46e4-4846-afb4-df3b111aaa26 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1674 microversion: 2.1 time: 0.153914 Jun 02 14:09:16.830792 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 592/1161] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:16 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:17.340703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-05cd4524-4b37-4610-861d-8217fc4a1c00 req-5c7f1f7a-d3b4-4e46-884e-3934be81df3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0222076-c3be-46b9-81c2-2f88404417aa", "name": "network-vif-deleted", "tag": "b85165e3-bd41-49ff-9007-f04034275503"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:09:17.351764 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-05cd4524-4b37-4610-861d-8217fc4a1c00 req-5c7f1f7a-d3b4-4e46-884e-3934be81df3c service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:17.354312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-05cd4524-4b37-4610-861d-8217fc4a1c00 req-5c7f1f7a-d3b4-4e46-884e-3934be81df3c service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:17.363676 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-05cd4524-4b37-4610-861d-8217fc4a1c00 req-5c7f1f7a-d3b4-4e46-884e-3934be81df3c service nova] Creating event network-vif-deleted:b85165e3-bd41-49ff-9007-f04034275503 for instance e0222076-c3be-46b9-81c2-2f88404417aa on hv-cinder-82651 Jun 02 14:09:17.370737 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-05cd4524-4b37-4610-861d-8217fc4a1c00 req-5c7f1f7a-d3b4-4e46-884e-3934be81df3c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033723 Jun 02 14:09:17.372301 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 570/1162] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:09:17.848214 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f5d0faa7-323b-40ba-99a9-687fed748967 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:17.848932 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f5d0faa7-323b-40ba-99a9-687fed748967 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:17.856009 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f5d0faa7-323b-40ba-99a9-687fed748967 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:17.857064 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f5d0faa7-323b-40ba-99a9-687fed748967 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:17.857851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f5d0faa7-323b-40ba-99a9-687fed748967 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:17.858294 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f5d0faa7-323b-40ba-99a9-687fed748967 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:17.929717 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f5d0faa7-323b-40ba-99a9-687fed748967 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:17.937840 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f5d0faa7-323b-40ba-99a9-687fed748967 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1606 microversion: 2.1 time: 0.093441 Jun 02 14:09:17.938425 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 593/1163] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:17 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1606 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:18.957679 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e3203ce4-384c-4f82-a109-e686a6f8f51b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:18.958388 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e3203ce4-384c-4f82-a109-e686a6f8f51b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:18.965154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e3203ce4-384c-4f82-a109-e686a6f8f51b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:18.965600 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e3203ce4-384c-4f82-a109-e686a6f8f51b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:18.966360 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e3203ce4-384c-4f82-a109-e686a6f8f51b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:18.966792 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e3203ce4-384c-4f82-a109-e686a6f8f51b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:19.031142 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e3203ce4-384c-4f82-a109-e686a6f8f51b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:19.039272 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e3203ce4-384c-4f82-a109-e686a6f8f51b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1606 microversion: 2.1 time: 0.086318 Jun 02 14:09:19.039834 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 571/1164] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:18 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1606 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:20.056994 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0f9c40a6-726a-4e50-9140-d0ef3128f2d9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:20.057609 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0f9c40a6-726a-4e50-9140-d0ef3128f2d9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:20.064143 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0f9c40a6-726a-4e50-9140-d0ef3128f2d9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:20.064631 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0f9c40a6-726a-4e50-9140-d0ef3128f2d9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:20.065391 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0f9c40a6-726a-4e50-9140-d0ef3128f2d9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:20.065849 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0f9c40a6-726a-4e50-9140-d0ef3128f2d9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:20.128188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0f9c40a6-726a-4e50-9140-d0ef3128f2d9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:20.137424 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0f9c40a6-726a-4e50-9140-d0ef3128f2d9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1322 microversion: 2.1 time: 0.084932 Jun 02 14:09:20.137998 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 594/1165] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:20 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1322 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:21.154275 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-aa2a3f1b-3308-4b60-a73b-23425352d809 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:21.154888 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-aa2a3f1b-3308-4b60-a73b-23425352d809 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:21.161535 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-aa2a3f1b-3308-4b60-a73b-23425352d809 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:21.161980 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-aa2a3f1b-3308-4b60-a73b-23425352d809 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:21.162735 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-aa2a3f1b-3308-4b60-a73b-23425352d809 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:21.163268 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-aa2a3f1b-3308-4b60-a73b-23425352d809 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:21.194099 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-aa2a3f1b-3308-4b60-a73b-23425352d809 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:21.195193 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-aa2a3f1b-3308-4b60-a73b-23425352d809 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:21.195608 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-aa2a3f1b-3308-4b60-a73b-23425352d809 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lazy-loading 'fault' on Instance uuid e0222076-c3be-46b9-81c2-2f88404417aa {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:09:21.236477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-aa2a3f1b-3308-4b60-a73b-23425352d809 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:21.244442 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-aa2a3f1b-3308-4b60-a73b-23425352d809 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1327 microversion: 2.1 time: 0.094032 Jun 02 14:09:21.244995 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 572/1166] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:21 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:22.261871 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f62c640b-f0a1-4331-bd38-c41af66e9298 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:22.262479 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f62c640b-f0a1-4331-bd38-c41af66e9298 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:22.269277 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f62c640b-f0a1-4331-bd38-c41af66e9298 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:22.269721 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f62c640b-f0a1-4331-bd38-c41af66e9298 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:22.270484 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f62c640b-f0a1-4331-bd38-c41af66e9298 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:22.270952 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f62c640b-f0a1-4331-bd38-c41af66e9298 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:22.302737 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f62c640b-f0a1-4331-bd38-c41af66e9298 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:22.303184 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f62c640b-f0a1-4331-bd38-c41af66e9298 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:22.303696 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-f62c640b-f0a1-4331-bd38-c41af66e9298 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lazy-loading 'fault' on Instance uuid e0222076-c3be-46b9-81c2-2f88404417aa {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:09:22.346644 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f62c640b-f0a1-4331-bd38-c41af66e9298 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:22.353894 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f62c640b-f0a1-4331-bd38-c41af66e9298 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 200 len: 1327 microversion: 2.1 time: 0.095870 Jun 02 14:09:22.356320 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 595/1167] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:22 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:23.371343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-88911c17-8e41-4641-a4db-0bc671b5b1a7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:23.371907 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-88911c17-8e41-4641-a4db-0bc671b5b1a7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:23.379066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-88911c17-8e41-4641-a4db-0bc671b5b1a7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:23.379507 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-88911c17-8e41-4641-a4db-0bc671b5b1a7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:23.380276 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-88911c17-8e41-4641-a4db-0bc671b5b1a7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:23.380711 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-88911c17-8e41-4641-a4db-0bc671b5b1a7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:23.394222 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-88911c17-8e41-4641-a4db-0bc671b5b1a7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] HTTP exception thrown: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-88911c17-8e41-4641-a4db-0bc671b5b1a7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Request method failure captured: Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa HTTP/1.1 Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimML4fRmfNYbmwK2CbDO5VOUE--ocSTsH77P9BhtEgdV-xQWZfyOCbqiySDst1bX2_FNbh-p2y0rVBKY1cNGf35FO010zDID8RuLsAhcjJNPAiLQNow3mC9U8H5Lz2ZxvZl-0eIirxbqLRSIILPIug6L8aXD-_-BbrwIf9ll0u2k_LyY Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: fbb232ab0a2347dea2fa82e1cdbf24b5 Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:09:23.395851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:09:23.398703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:09:23.398703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:09:23.398703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: fbb232ab0a2347dea2fa82e1cdbf24b5 Jun 02 14:09:23.398703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:09:23.398703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeTestJSON-676059352-project Jun 02 14:09:23.398703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:09:23.398703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:09:23.398703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 36e78feea3104797a5e927c8ffb76d18 Jun 02 14:09:23.398703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeTestJSON-676059352-project Jun 02 14:09:23.398703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:09:23.398703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:09:23.398703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': 'e0222076-c3be-46b9-81c2-2f88404417aa'} Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:09:23.399709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:09:23.401436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:09:23.402883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-88911c17-8e41-4641-a4db-0bc671b5b1a7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Returning 404 to user: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:09:23.402883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-88911c17-8e41-4641-a4db-0bc671b5b1a7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 404 len: 111 microversion: 2.1 time: 0.029993 Jun 02 14:09:23.402883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 573/1168] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:23 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 14:09:23.407396 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e9e279ed-53d1-4516-aee1-b618d0a30679 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '.version_select at 0x7fb72417ce50>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:23.482069 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e9e279ed-53d1-4516-aee1-b618d0a30679 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2146280950" status: 202 len: 0 microversion: 2.1 time: 0.078699 Jun 02 14:09:23.482673 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 596/1169] 10.222.0.33 () {58 vars in 1220 bytes} [Thu Jun 2 14:09:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2146280950 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:09:23.953574 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-368724e7-d8c6-4343-94ad-d5c991693927 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d055828-21f2-4f5f-ae12-002796cb9a36", "device": "/dev/sdb"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:09:23.955067 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-368724e7-d8c6-4343-94ad-d5c991693927 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:23.961860 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-368724e7-d8c6-4343-94ad-d5c991693927 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:23.962307 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-368724e7-d8c6-4343-94ad-d5c991693927 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:23.963072 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-368724e7-d8c6-4343-94ad-d5c991693927 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:23.963502 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-368724e7-d8c6-4343-94ad-d5c991693927 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:24.270268 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-40addbfc-abe2-412f-a278-5e07220eb37f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Action: 'create', calling method: .version_select at 0x7fb71acd4c10>, body: {"keypair": {"name": "tempest-keypair-1847344968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ25RNLv3REpXDRgg/Ap3U0B6ninbKgs+blAg9Xlt3Dm5IHsBENXOcDwEjTh4BOfcF9tcu4KYxQFXtqfN7OBn7lrRbB6jh2U7dj8Xqdo4ssr2+VZrzwy4lZA1vXEV0kFrw=="}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:09:24.285950 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-40addbfc-abe2-412f-a278-5e07220eb37f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Getting quotas for project fbb232ab0a2347dea2fa82e1cdbf24b5. Resources: {'key_pairs'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:09:24.289890 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-40addbfc-abe2-412f-a278-5e07220eb37f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Getting quotas for user 36e78feea3104797a5e927c8ffb76d18 and project fbb232ab0a2347dea2fa82e1cdbf24b5. Resources: {'key_pairs'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:09:24.388446 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-40addbfc-abe2-412f-a278-5e07220eb37f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121920 Jun 02 14:09:24.389084 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 597/1170] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 2 14:09:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:09:24.816978 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-368724e7-d8c6-4343-94ad-d5c991693927 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "POST /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.867127 Jun 02 14:09:24.817598 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 574/1171] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 2 14:09:23 2022] POST /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72/os-volume_attachments => generated 194 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:09:26.830928 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-681961479", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7cd32eca-d3a3-4153-bf1f-a37e8fefca27"}], "security_groups": [{"name": "tempest-securitygroup--461655314"}], "key_name": "tempest-keypair-1847344968", "user_data": "}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:09:26.933598 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.network.neutron [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] validate_networks() for [('7cd32eca-d3a3-4153-bf1f-a37e8fefca27', None, None, None, None, None)] {{(pid=118316) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 14:09:27.310431 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Flavor limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 14:09:27.310856 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Image limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 14:09:27.311330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Flavor pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 14:09:27.311741 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Image pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 14:09:27.312152 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 14:09:27.321829 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:27.322273 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:27.323070 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:27.323546 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:27.341237 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Getting quotas for project fbb232ab0a2347dea2fa82e1cdbf24b5. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:09:27.345155 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Getting quotas for user 36e78feea3104797a5e927c8ffb76d18 and project fbb232ab0a2347dea2fa82e1cdbf24b5. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:09:27.356511 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Going to run 1 instances... {{(pid=118316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 14:09:27.358787 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 14:09:27.501173 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ab996039-e15e-433e-b4a7-34045290b22f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.674964 Jun 02 14:09:27.503052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 598/1172] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 14:09:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 14:09:27.514633 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f972d47c-46fc-4a52-ae19-0b01091d3f8c tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:27.515399 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f972d47c-46fc-4a52-ae19-0b01091d3f8c tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:27.587975 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-f972d47c-46fc-4a52-ae19-0b01091d3f8c tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:27.594909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f972d47c-46fc-4a52-ae19-0b01091d3f8c tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1237 microversion: 2.1 time: 0.085068 Jun 02 14:09:27.595493 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 575/1173] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:27 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:28.611798 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8753f085-3edf-44ac-8fcb-849737af7476 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:28.612538 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8753f085-3edf-44ac-8fcb-849737af7476 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:28.619149 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8753f085-3edf-44ac-8fcb-849737af7476 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:28.619597 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8753f085-3edf-44ac-8fcb-849737af7476 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:28.620356 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8753f085-3edf-44ac-8fcb-849737af7476 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:28.620822 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8753f085-3edf-44ac-8fcb-849737af7476 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:28.685320 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8753f085-3edf-44ac-8fcb-849737af7476 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:28.692889 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8753f085-3edf-44ac-8fcb-849737af7476 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1241 microversion: 2.1 time: 0.085027 Jun 02 14:09:28.693449 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 599/1174] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:28 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:09:29.710040 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ba278cc1-8c8e-4e51-849f-2e34ae13a793 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:29.712381 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ba278cc1-8c8e-4e51-849f-2e34ae13a793 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:29.718332 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ba278cc1-8c8e-4e51-849f-2e34ae13a793 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:29.718783 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ba278cc1-8c8e-4e51-849f-2e34ae13a793 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:29.719547 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ba278cc1-8c8e-4e51-849f-2e34ae13a793 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:29.719983 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ba278cc1-8c8e-4e51-849f-2e34ae13a793 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:29.785477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ba278cc1-8c8e-4e51-849f-2e34ae13a793 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:29.795326 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ba278cc1-8c8e-4e51-849f-2e34ae13a793 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1297 microversion: 2.1 time: 0.089111 Jun 02 14:09:29.795906 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 576/1175] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:29 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:30.813307 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-64b05643-08b2-45ac-a765-46e4426b5704 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:30.813920 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-64b05643-08b2-45ac-a765-46e4426b5704 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:30.821114 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-64b05643-08b2-45ac-a765-46e4426b5704 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:30.821566 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-64b05643-08b2-45ac-a765-46e4426b5704 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:30.822392 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-64b05643-08b2-45ac-a765-46e4426b5704 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:30.822826 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-64b05643-08b2-45ac-a765-46e4426b5704 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:30.961736 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-64b05643-08b2-45ac-a765-46e4426b5704 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:30.969148 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-64b05643-08b2-45ac-a765-46e4426b5704 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.159814 Jun 02 14:09:30.969724 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 600/1176] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:30 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:31.418832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-878a8a35-ac10-453b-8669-bf7623fb84c5 req-97c01d82-f87f-4935-aa08-401fe1e8bb5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c22317-c373-4b44-a6b5-afe350428145", "tag": "6e88a7f3-57a4-44c6-9d5e-feaf2a0c613f"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:09:31.428700 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-878a8a35-ac10-453b-8669-bf7623fb84c5 req-97c01d82-f87f-4935-aa08-401fe1e8bb5e service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:31.430049 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-878a8a35-ac10-453b-8669-bf7623fb84c5 req-97c01d82-f87f-4935-aa08-401fe1e8bb5e service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:31.451075 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-878a8a35-ac10-453b-8669-bf7623fb84c5 req-97c01d82-f87f-4935-aa08-401fe1e8bb5e service nova] Creating event network-changed:6e88a7f3-57a4-44c6-9d5e-feaf2a0c613f for instance 38c22317-c373-4b44-a6b5-afe350428145 on hv-cinder-82651 Jun 02 14:09:31.455889 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-878a8a35-ac10-453b-8669-bf7623fb84c5 req-97c01d82-f87f-4935-aa08-401fe1e8bb5e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043068 Jun 02 14:09:31.456523 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 577/1177] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:09:31.987123 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-db7537a7-2893-42ed-ac46-b4812f3499c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:31.987737 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-db7537a7-2893-42ed-ac46-b4812f3499c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:31.994902 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-db7537a7-2893-42ed-ac46-b4812f3499c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:31.995355 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-db7537a7-2893-42ed-ac46-b4812f3499c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:31.996116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-db7537a7-2893-42ed-ac46-b4812f3499c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:31.996606 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-db7537a7-2893-42ed-ac46-b4812f3499c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:32.135552 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-db7537a7-2893-42ed-ac46-b4812f3499c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:32.143021 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-db7537a7-2893-42ed-ac46-b4812f3499c0 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.159764 Jun 02 14:09:32.143596 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 601/1178] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:31 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:33.161747 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0ca65020-409c-4e02-be75-2d3c9c537fbe tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:33.162429 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0ca65020-409c-4e02-be75-2d3c9c537fbe tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:33.168907 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0ca65020-409c-4e02-be75-2d3c9c537fbe tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:33.169354 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0ca65020-409c-4e02-be75-2d3c9c537fbe tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:33.170196 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0ca65020-409c-4e02-be75-2d3c9c537fbe tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:33.170634 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0ca65020-409c-4e02-be75-2d3c9c537fbe tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:33.304658 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0ca65020-409c-4e02-be75-2d3c9c537fbe tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:33.312292 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0ca65020-409c-4e02-be75-2d3c9c537fbe tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.155484 Jun 02 14:09:33.312887 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 578/1179] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:33 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:34.330321 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-1f447791-326a-4806-9345-27c7c0549f44 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:34.330926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-1f447791-326a-4806-9345-27c7c0549f44 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:34.337218 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1f447791-326a-4806-9345-27c7c0549f44 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:34.337655 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1f447791-326a-4806-9345-27c7c0549f44 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:34.338392 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1f447791-326a-4806-9345-27c7c0549f44 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:34.338820 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1f447791-326a-4806-9345-27c7c0549f44 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:34.464922 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1f447791-326a-4806-9345-27c7c0549f44 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:34.472174 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-1f447791-326a-4806-9345-27c7c0549f44 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.145696 Jun 02 14:09:34.472765 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 602/1180] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:34 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:35.489666 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-df95c6d7-4da1-4ad6-9b8e-d61c6576b9e5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:35.490277 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-df95c6d7-4da1-4ad6-9b8e-d61c6576b9e5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:35.497382 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-df95c6d7-4da1-4ad6-9b8e-d61c6576b9e5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:35.497852 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-df95c6d7-4da1-4ad6-9b8e-d61c6576b9e5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:35.498682 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-df95c6d7-4da1-4ad6-9b8e-d61c6576b9e5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:35.499138 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-df95c6d7-4da1-4ad6-9b8e-d61c6576b9e5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:35.630531 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-df95c6d7-4da1-4ad6-9b8e-d61c6576b9e5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:35.638711 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-df95c6d7-4da1-4ad6-9b8e-d61c6576b9e5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.152899 Jun 02 14:09:35.639277 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 579/1181] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:35 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:36.655351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4cf4bc9d-25fa-4ead-9813-f3cbd3b3e0fb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:36.655996 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4cf4bc9d-25fa-4ead-9813-f3cbd3b3e0fb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:36.662707 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4cf4bc9d-25fa-4ead-9813-f3cbd3b3e0fb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:36.663159 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4cf4bc9d-25fa-4ead-9813-f3cbd3b3e0fb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:36.664789 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4cf4bc9d-25fa-4ead-9813-f3cbd3b3e0fb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:36.665225 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4cf4bc9d-25fa-4ead-9813-f3cbd3b3e0fb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:36.794402 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4cf4bc9d-25fa-4ead-9813-f3cbd3b3e0fb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:36.801868 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4cf4bc9d-25fa-4ead-9813-f3cbd3b3e0fb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.150397 Jun 02 14:09:36.802449 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 603/1182] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:36 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:37.818867 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-92a926a5-2eef-49ce-af7b-6dcf3aa3a056 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:37.819479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-92a926a5-2eef-49ce-af7b-6dcf3aa3a056 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:37.822629 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=2 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:37.827615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-92a926a5-2eef-49ce-af7b-6dcf3aa3a056 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:37.828102 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-92a926a5-2eef-49ce-af7b-6dcf3aa3a056 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:37.828910 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-92a926a5-2eef-49ce-af7b-6dcf3aa3a056 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:37.829383 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-92a926a5-2eef-49ce-af7b-6dcf3aa3a056 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:37.967400 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-92a926a5-2eef-49ce-af7b-6dcf3aa3a056 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:37.974791 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-92a926a5-2eef-49ce-af7b-6dcf3aa3a056 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.160183 Jun 02 14:09:37.978510 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 580/1183] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:37 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:38.992603 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-addf97f5-b7f3-4bec-9ccb-c0fd9c7f95ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:38.993267 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-addf97f5-b7f3-4bec-9ccb-c0fd9c7f95ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:38.995298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:38.995977 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=10 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:39.001459 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-addf97f5-b7f3-4bec-9ccb-c0fd9c7f95ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:39.001910 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-addf97f5-b7f3-4bec-9ccb-c0fd9c7f95ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:39.002671 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-addf97f5-b7f3-4bec-9ccb-c0fd9c7f95ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:39.003122 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-addf97f5-b7f3-4bec-9ccb-c0fd9c7f95ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:39.132976 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-addf97f5-b7f3-4bec-9ccb-c0fd9c7f95ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:39.140251 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-addf97f5-b7f3-4bec-9ccb-c0fd9c7f95ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.151603 Jun 02 14:09:39.140856 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 604/1184] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:38 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:40.157428 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-20bf2f36-8810-4546-be44-2ebf6d71107b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:40.158045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-20bf2f36-8810-4546-be44-2ebf6d71107b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:40.165251 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-20bf2f36-8810-4546-be44-2ebf6d71107b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:40.165703 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-20bf2f36-8810-4546-be44-2ebf6d71107b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:40.166467 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-20bf2f36-8810-4546-be44-2ebf6d71107b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:40.166907 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-20bf2f36-8810-4546-be44-2ebf6d71107b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:40.303049 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-20bf2f36-8810-4546-be44-2ebf6d71107b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:40.311595 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-20bf2f36-8810-4546-be44-2ebf6d71107b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.158380 Jun 02 14:09:40.312155 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 581/1185] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:40 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:41.328992 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3dd4b7c6-e10a-48f2-9e66-50d12176b512 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:41.329595 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3dd4b7c6-e10a-48f2-9e66-50d12176b512 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:41.331861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:41.337382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3dd4b7c6-e10a-48f2-9e66-50d12176b512 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:41.337834 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3dd4b7c6-e10a-48f2-9e66-50d12176b512 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:41.338603 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3dd4b7c6-e10a-48f2-9e66-50d12176b512 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:41.339043 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3dd4b7c6-e10a-48f2-9e66-50d12176b512 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:41.469994 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3dd4b7c6-e10a-48f2-9e66-50d12176b512 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:41.477821 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3dd4b7c6-e10a-48f2-9e66-50d12176b512 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.152685 Jun 02 14:09:41.478416 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 605/1186] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:41 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:42.494674 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ba7c13fe-5836-4535-b6cb-73dfc46816b7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:42.495305 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ba7c13fe-5836-4535-b6cb-73dfc46816b7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:42.497683 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=37 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:42.502666 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ba7c13fe-5836-4535-b6cb-73dfc46816b7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:42.503149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ba7c13fe-5836-4535-b6cb-73dfc46816b7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:42.503971 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ba7c13fe-5836-4535-b6cb-73dfc46816b7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:42.504436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ba7c13fe-5836-4535-b6cb-73dfc46816b7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:42.508152 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:42.638100 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ba7c13fe-5836-4535-b6cb-73dfc46816b7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:42.645962 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ba7c13fe-5836-4535-b6cb-73dfc46816b7 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.155422 Jun 02 14:09:42.646573 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 582/1187] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:42 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:43.664116 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-0c23c238-7499-427f-a15a-4eccdcf135ea tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:43.664754 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-0c23c238-7499-427f-a15a-4eccdcf135ea tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:43.671167 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0c23c238-7499-427f-a15a-4eccdcf135ea tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:43.675677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0c23c238-7499-427f-a15a-4eccdcf135ea tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:43.675677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0c23c238-7499-427f-a15a-4eccdcf135ea tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:43.675677 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-0c23c238-7499-427f-a15a-4eccdcf135ea tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:43.676676 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:43.807459 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-0c23c238-7499-427f-a15a-4eccdcf135ea tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:43.815085 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-0c23c238-7499-427f-a15a-4eccdcf135ea tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.155930 Jun 02 14:09:43.815905 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 606/1188] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:43 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:44.833423 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ee8c8d81-bf4c-4c8a-bb63-0377c2f8819f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:44.834032 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ee8c8d81-bf4c-4c8a-bb63-0377c2f8819f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:44.840910 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ee8c8d81-bf4c-4c8a-bb63-0377c2f8819f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:44.841359 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ee8c8d81-bf4c-4c8a-bb63-0377c2f8819f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:44.842097 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ee8c8d81-bf4c-4c8a-bb63-0377c2f8819f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:44.842528 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ee8c8d81-bf4c-4c8a-bb63-0377c2f8819f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:44.979666 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ee8c8d81-bf4c-4c8a-bb63-0377c2f8819f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:44.987142 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ee8c8d81-bf4c-4c8a-bb63-0377c2f8819f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.158060 Jun 02 14:09:44.987724 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 583/1189] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:44 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:09:46.004861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e498fe62-8ab9-462c-b8ee-1a6050ca2353 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:46.005483 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e498fe62-8ab9-462c-b8ee-1a6050ca2353 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:46.012439 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e498fe62-8ab9-462c-b8ee-1a6050ca2353 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:46.012890 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e498fe62-8ab9-462c-b8ee-1a6050ca2353 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:46.013653 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e498fe62-8ab9-462c-b8ee-1a6050ca2353 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:46.014089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e498fe62-8ab9-462c-b8ee-1a6050ca2353 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:46.147087 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e498fe62-8ab9-462c-b8ee-1a6050ca2353 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:46.154535 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e498fe62-8ab9-462c-b8ee-1a6050ca2353 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.153686 Jun 02 14:09:46.155103 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 607/1190] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:45 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:47.172678 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-bd4ed35c-cdc5-4f24-afac-e89bf7960c55 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:47.173314 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-bd4ed35c-cdc5-4f24-afac-e89bf7960c55 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:47.181097 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd4ed35c-cdc5-4f24-afac-e89bf7960c55 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:47.181563 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd4ed35c-cdc5-4f24-afac-e89bf7960c55 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:47.182342 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd4ed35c-cdc5-4f24-afac-e89bf7960c55 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:47.182793 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-bd4ed35c-cdc5-4f24-afac-e89bf7960c55 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:47.313786 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-bd4ed35c-cdc5-4f24-afac-e89bf7960c55 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:47.321435 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-bd4ed35c-cdc5-4f24-afac-e89bf7960c55 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.153607 Jun 02 14:09:47.321991 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 584/1191] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:47 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:48.337555 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6da54822-9858-4ed3-b1a8-a18b5bba7798 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:48.338168 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-6da54822-9858-4ed3-b1a8-a18b5bba7798 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:48.344562 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6da54822-9858-4ed3-b1a8-a18b5bba7798 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:48.345001 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6da54822-9858-4ed3-b1a8-a18b5bba7798 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:48.345742 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6da54822-9858-4ed3-b1a8-a18b5bba7798 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:48.346163 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-6da54822-9858-4ed3-b1a8-a18b5bba7798 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:48.478167 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-6da54822-9858-4ed3-b1a8-a18b5bba7798 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:48.485745 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6da54822-9858-4ed3-b1a8-a18b5bba7798 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.152376 Jun 02 14:09:48.486325 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 608/1192] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:48 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:49.503097 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c63b498d-ccbb-4120-96ab-c0fbef00eb5f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:49.503724 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c63b498d-ccbb-4120-96ab-c0fbef00eb5f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:49.511497 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c63b498d-ccbb-4120-96ab-c0fbef00eb5f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:49.518344 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c63b498d-ccbb-4120-96ab-c0fbef00eb5f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:49.518344 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c63b498d-ccbb-4120-96ab-c0fbef00eb5f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:49.518344 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c63b498d-ccbb-4120-96ab-c0fbef00eb5f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:49.650249 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-c63b498d-ccbb-4120-96ab-c0fbef00eb5f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:49.657768 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c63b498d-ccbb-4120-96ab-c0fbef00eb5f tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.158681 Jun 02 14:09:49.658366 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 585/1193] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:49 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:50.587415 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [req-a43f3935-2aae-444a-b838-5d8aa28f8910 req-1cdca969-8a6d-4415-ab69-f517456c021d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c22317-c373-4b44-a6b5-afe350428145", "name": "network-vif-plugged", "status": "completed", "tag": "6e88a7f3-57a4-44c6-9d5e-feaf2a0c613f"}]} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:09:50.597651 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-a43f3935-2aae-444a-b838-5d8aa28f8910 req-1cdca969-8a6d-4415-ab69-f517456c021d service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:50.598130 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [req-a43f3935-2aae-444a-b838-5d8aa28f8910 req-1cdca969-8a6d-4415-ab69-f517456c021d service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:50.610198 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.compute.server_external_events [req-a43f3935-2aae-444a-b838-5d8aa28f8910 req-1cdca969-8a6d-4415-ab69-f517456c021d service nova] Creating event network-vif-plugged:6e88a7f3-57a4-44c6-9d5e-feaf2a0c613f for instance 38c22317-c373-4b44-a6b5-afe350428145 on hv-cinder-82651 Jun 02 14:09:50.615351 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [req-a43f3935-2aae-444a-b838-5d8aa28f8910 req-1cdca969-8a6d-4415-ab69-f517456c021d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033523 Jun 02 14:09:50.615931 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 609/1194] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:09:50.676611 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-901f5827-ee96-4573-9e39-998df66f8cdb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:50.677253 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-901f5827-ee96-4573-9e39-998df66f8cdb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:50.689580 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-901f5827-ee96-4573-9e39-998df66f8cdb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:50.690037 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-901f5827-ee96-4573-9e39-998df66f8cdb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:50.691574 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-901f5827-ee96-4573-9e39-998df66f8cdb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:50.692203 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-901f5827-ee96-4573-9e39-998df66f8cdb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:50.828604 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-901f5827-ee96-4573-9e39-998df66f8cdb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:50.837179 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-901f5827-ee96-4573-9e39-998df66f8cdb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.164486 Jun 02 14:09:50.837748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 586/1195] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:50 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:51.848859 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:09:51.849531 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Thu Jun 2 14:09:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:09:51.855563 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8abb1d24-bff6-4547-9570-649580e4e3b5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:51.856249 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8abb1d24-bff6-4547-9570-649580e4e3b5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:51.862495 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8abb1d24-bff6-4547-9570-649580e4e3b5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:51.868018 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8abb1d24-bff6-4547-9570-649580e4e3b5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:51.868018 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8abb1d24-bff6-4547-9570-649580e4e3b5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:51.868018 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8abb1d24-bff6-4547-9570-649580e4e3b5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:52.000118 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8abb1d24-bff6-4547-9570-649580e4e3b5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:52.008962 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8abb1d24-bff6-4547-9570-649580e4e3b5 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.158549 Jun 02 14:09:52.011602 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 610/1196] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:51 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:53.032121 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-58f1ba91-520e-4d14-a983-7801189e5464 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:53.032794 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-58f1ba91-520e-4d14-a983-7801189e5464 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:53.040054 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-58f1ba91-520e-4d14-a983-7801189e5464 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:53.040842 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-58f1ba91-520e-4d14-a983-7801189e5464 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:53.041616 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-58f1ba91-520e-4d14-a983-7801189e5464 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:53.042054 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-58f1ba91-520e-4d14-a983-7801189e5464 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:53.232305 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-58f1ba91-520e-4d14-a983-7801189e5464 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:53.239852 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-58f1ba91-520e-4d14-a983-7801189e5464 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.211931 Jun 02 14:09:53.240430 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 587/1197] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:53 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:54.258129 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-341b3eb9-6f71-414d-b70b-fc18a65b4ece tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:54.259300 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-341b3eb9-6f71-414d-b70b-fc18a65b4ece tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:54.265917 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-341b3eb9-6f71-414d-b70b-fc18a65b4ece tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:54.266367 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-341b3eb9-6f71-414d-b70b-fc18a65b4ece tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:54.267135 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-341b3eb9-6f71-414d-b70b-fc18a65b4ece tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:54.267565 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-341b3eb9-6f71-414d-b70b-fc18a65b4ece tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:54.407705 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-341b3eb9-6f71-414d-b70b-fc18a65b4ece tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:54.416248 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-341b3eb9-6f71-414d-b70b-fc18a65b4ece tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.162900 Jun 02 14:09:54.416859 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 611/1198] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:54 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:55.434406 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7f709a8d-98e8-487d-901e-b861621154ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:55.434406 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7f709a8d-98e8-487d-901e-b861621154ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:55.441056 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7f709a8d-98e8-487d-901e-b861621154ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:55.441503 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7f709a8d-98e8-487d-901e-b861621154ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:55.442269 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7f709a8d-98e8-487d-901e-b861621154ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:55.442708 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7f709a8d-98e8-487d-901e-b861621154ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:55.573864 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7f709a8d-98e8-487d-901e-b861621154ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:55.581509 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7f709a8d-98e8-487d-901e-b861621154ba tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.151730 Jun 02 14:09:55.582077 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 588/1199] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:55 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:56.598209 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a0cb54d5-db79-45dd-aa4d-c0596c6095da tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:56.598950 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a0cb54d5-db79-45dd-aa4d-c0596c6095da tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:56.606051 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a0cb54d5-db79-45dd-aa4d-c0596c6095da tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:56.606552 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a0cb54d5-db79-45dd-aa4d-c0596c6095da tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:56.607298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a0cb54d5-db79-45dd-aa4d-c0596c6095da tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:56.607721 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a0cb54d5-db79-45dd-aa4d-c0596c6095da tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:56.755177 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a0cb54d5-db79-45dd-aa4d-c0596c6095da tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:56.763523 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a0cb54d5-db79-45dd-aa4d-c0596c6095da tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1362 microversion: 2.1 time: 0.169080 Jun 02 14:09:56.764104 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 612/1200] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:56 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:57.780985 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-707e5ee6-35ba-4b50-88fa-0f6d5601d62b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:57.781709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-707e5ee6-35ba-4b50-88fa-0f6d5601d62b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:57.788943 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-707e5ee6-35ba-4b50-88fa-0f6d5601d62b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:57.789392 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-707e5ee6-35ba-4b50-88fa-0f6d5601d62b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:57.790152 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-707e5ee6-35ba-4b50-88fa-0f6d5601d62b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:57.790589 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-707e5ee6-35ba-4b50-88fa-0f6d5601d62b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:57.922498 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-707e5ee6-35ba-4b50-88fa-0f6d5601d62b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:09:57.930034 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-707e5ee6-35ba-4b50-88fa-0f6d5601d62b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1547 microversion: 2.1 time: 0.152945 Jun 02 14:09:57.930601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 589/1201] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:09:57 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:09:57.950827 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d923a6e2-59bb-42c3-9f47-1c386dd7bae1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:57.951397 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d923a6e2-59bb-42c3-9f47-1c386dd7bae1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:57.957801 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d923a6e2-59bb-42c3-9f47-1c386dd7bae1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:57.958240 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d923a6e2-59bb-42c3-9f47-1c386dd7bae1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:57.958980 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d923a6e2-59bb-42c3-9f47-1c386dd7bae1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:57.959409 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d923a6e2-59bb-42c3-9f47-1c386dd7bae1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:58.036048 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d923a6e2-59bb-42c3-9f47-1c386dd7bae1 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089141 Jun 02 14:09:58.036801 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 613/1202] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 2 14:09:57 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:09:59.301919 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-3d5b3c40-9cdd-40b1-80e8-c601b557f2f5 req-9de20448-9002-46d9-b909-6d8863ca320e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c22317-c373-4b44-a6b5-afe350428145", "tag": "6e88a7f3-57a4-44c6-9d5e-feaf2a0c613f"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:09:59.309643 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-3d5b3c40-9cdd-40b1-80e8-c601b557f2f5 req-9de20448-9002-46d9-b909-6d8863ca320e service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:59.310083 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-3d5b3c40-9cdd-40b1-80e8-c601b557f2f5 req-9de20448-9002-46d9-b909-6d8863ca320e service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:59.324911 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-3d5b3c40-9cdd-40b1-80e8-c601b557f2f5 req-9de20448-9002-46d9-b909-6d8863ca320e service nova] Creating event network-changed:6e88a7f3-57a4-44c6-9d5e-feaf2a0c613f for instance 38c22317-c373-4b44-a6b5-afe350428145 on hv-cinder-82651 Jun 02 14:09:59.330290 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-3d5b3c40-9cdd-40b1-80e8-c601b557f2f5 req-9de20448-9002-46d9-b909-6d8863ca320e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033655 Jun 02 14:09:59.331171 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 590/1203] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:09:59.872748 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4763b323-4211-43f2-9b24-3aaf0825a7a8 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:09:59.873296 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4763b323-4211-43f2-9b24-3aaf0825a7a8 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:09:59.880663 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4763b323-4211-43f2-9b24-3aaf0825a7a8 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:59.881110 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4763b323-4211-43f2-9b24-3aaf0825a7a8 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:59.882619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4763b323-4211-43f2-9b24-3aaf0825a7a8 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:09:59.883394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4763b323-4211-43f2-9b24-3aaf0825a7a8 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:09:59.979134 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-4763b323-4211-43f2-9b24-3aaf0825a7a8 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lazy-loading 'services' on Instance uuid afbaac83-7a31-4b52-b437-932af9997a72 {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:10:00.217259 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4763b323-4211-43f2-9b24-3aaf0825a7a8 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "DELETE /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72/os-volume_attachments/0d055828-21f2-4f5f-ae12-002796cb9a36" status: 202 len: 0 microversion: 2.1 time: 0.348606 Jun 02 14:10:00.217867 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 614/1204] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 2 14:09:59 2022] DELETE /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72/os-volume_attachments/0d055828-21f2-4f5f-ae12-002796cb9a36 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:10:01.404677 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-092e9104-1abe-42fe-8243-05d899f1cd0d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:01.407180 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-092e9104-1abe-42fe-8243-05d899f1cd0d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:01.411502 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-092e9104-1abe-42fe-8243-05d899f1cd0d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:01.411968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-092e9104-1abe-42fe-8243-05d899f1cd0d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:01.412766 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-092e9104-1abe-42fe-8243-05d899f1cd0d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:01.413200 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-092e9104-1abe-42fe-8243-05d899f1cd0d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:01.438834 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-092e9104-1abe-42fe-8243-05d899f1cd0d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Going to try to terminate instance {{(pid=118315) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:10:01.760133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-092e9104-1abe-42fe-8243-05d899f1cd0d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "DELETE /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 204 len: 0 microversion: 2.1 time: 0.359950 Jun 02 14:10:01.760821 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 591/1205] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:10:01 2022] DELETE /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:10:01.769980 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e6f4375e-a4af-4525-a9e5-a92f39364b0c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:01.770756 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e6f4375e-a4af-4525-a9e5-a92f39364b0c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:01.777610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6f4375e-a4af-4525-a9e5-a92f39364b0c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:01.778054 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6f4375e-a4af-4525-a9e5-a92f39364b0c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:01.778813 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6f4375e-a4af-4525-a9e5-a92f39364b0c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:01.779253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e6f4375e-a4af-4525-a9e5-a92f39364b0c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:01.913835 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e6f4375e-a4af-4525-a9e5-a92f39364b0c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:01.921684 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e6f4375e-a4af-4525-a9e5-a92f39364b0c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1512 microversion: 2.1 time: 0.156527 Jun 02 14:10:01.922241 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 615/1206] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:01 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:02.939505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7646a35e-d7d8-430e-a7cd-7f8efe075881 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:02.940227 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7646a35e-d7d8-430e-a7cd-7f8efe075881 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:02.947259 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7646a35e-d7d8-430e-a7cd-7f8efe075881 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:02.947732 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7646a35e-d7d8-430e-a7cd-7f8efe075881 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:02.948564 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7646a35e-d7d8-430e-a7cd-7f8efe075881 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:02.949016 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7646a35e-d7d8-430e-a7cd-7f8efe075881 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:03.078841 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7646a35e-d7d8-430e-a7cd-7f8efe075881 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:03.087160 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7646a35e-d7d8-430e-a7cd-7f8efe075881 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1512 microversion: 2.1 time: 0.151856 Jun 02 14:10:03.087735 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 592/1207] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:02 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:04.104750 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-315daafa-10ec-480d-93f1-42ee6c342935 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:04.105357 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-315daafa-10ec-480d-93f1-42ee6c342935 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:04.111624 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-315daafa-10ec-480d-93f1-42ee6c342935 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:04.112064 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-315daafa-10ec-480d-93f1-42ee6c342935 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:04.112833 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-315daafa-10ec-480d-93f1-42ee6c342935 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:04.113306 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-315daafa-10ec-480d-93f1-42ee6c342935 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:04.250095 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-315daafa-10ec-480d-93f1-42ee6c342935 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:04.259447 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-315daafa-10ec-480d-93f1-42ee6c342935 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1512 microversion: 2.1 time: 0.159313 Jun 02 14:10:04.260341 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 616/1208] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:04 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:04.691990 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-59e15b3c-04d1-4bfa-895a-fb52ca8a1d66 req-3ff353ce-629b-4c9e-bd10-7331edda33b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afbaac83-7a31-4b52-b437-932af9997a72", "name": "network-vif-deleted", "tag": "2e7167b3-6bcc-4ae3-8cdf-c53fcc3520ed"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:10:04.701607 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-59e15b3c-04d1-4bfa-895a-fb52ca8a1d66 req-3ff353ce-629b-4c9e-bd10-7331edda33b3 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:04.702047 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-59e15b3c-04d1-4bfa-895a-fb52ca8a1d66 req-3ff353ce-629b-4c9e-bd10-7331edda33b3 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:04.713618 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-59e15b3c-04d1-4bfa-895a-fb52ca8a1d66 req-3ff353ce-629b-4c9e-bd10-7331edda33b3 service nova] Creating event network-vif-deleted:2e7167b3-6bcc-4ae3-8cdf-c53fcc3520ed for instance afbaac83-7a31-4b52-b437-932af9997a72 on hv-cinder-82651 Jun 02 14:10:04.718688 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-59e15b3c-04d1-4bfa-895a-fb52ca8a1d66 req-3ff353ce-629b-4c9e-bd10-7331edda33b3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030801 Jun 02 14:10:04.719503 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 593/1209] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:10:05.276291 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3c64aa8e-15cb-40ca-a9dd-451ef7a608a4 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:05.276930 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-3c64aa8e-15cb-40ca-a9dd-451ef7a608a4 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:05.283334 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3c64aa8e-15cb-40ca-a9dd-451ef7a608a4 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:05.284576 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3c64aa8e-15cb-40ca-a9dd-451ef7a608a4 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:05.284576 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3c64aa8e-15cb-40ca-a9dd-451ef7a608a4 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:05.284960 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3c64aa8e-15cb-40ca-a9dd-451ef7a608a4 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:05.315592 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3c64aa8e-15cb-40ca-a9dd-451ef7a608a4 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:05.316037 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-3c64aa8e-15cb-40ca-a9dd-451ef7a608a4 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:05.316511 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-3c64aa8e-15cb-40ca-a9dd-451ef7a608a4 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lazy-loading 'fault' on Instance uuid afbaac83-7a31-4b52-b437-932af9997a72 {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:10:05.358277 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-3c64aa8e-15cb-40ca-a9dd-451ef7a608a4 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:05.368495 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3c64aa8e-15cb-40ca-a9dd-451ef7a608a4 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 200 len: 1308 microversion: 2.1 time: 0.096059 Jun 02 14:10:05.369398 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 617/1210] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:05 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:06.386392 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0994f44a-15a6-4e6d-bbf5-c2be6b0f90ab tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:06.387094 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0994f44a-15a6-4e6d-bbf5-c2be6b0f90ab tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: afbaac83-7a31-4b52-b437-932af9997a72] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:06.393363 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0994f44a-15a6-4e6d-bbf5-c2be6b0f90ab tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:06.393805 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0994f44a-15a6-4e6d-bbf5-c2be6b0f90ab tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:06.394555 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0994f44a-15a6-4e6d-bbf5-c2be6b0f90ab tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:06.394989 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0994f44a-15a6-4e6d-bbf5-c2be6b0f90ab tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:06.408436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-0994f44a-15a6-4e6d-bbf5-c2be6b0f90ab tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] HTTP exception thrown: Instance afbaac83-7a31-4b52-b437-932af9997a72 could not be found. Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0994f44a-15a6-4e6d-bbf5-c2be6b0f90ab tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Request method failure captured: Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 HTTP/1.1 Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMRapZOReXKjliFb6ALs3FMo8h-T0Kj9iSxi5VvaPk1x3w-B1oQFOhIj0ER3RiUvCOBAEtgbaWuLPoXPAnFCCaI5KYrcIkNVDy_zH6_q0uz0mUmrC1pH094mZeKc0nNac78uaTLC4N6USCmnSZMqKA69yVSPL4MDVr8Mmb3PBcfVwVo Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 48bc1d636aba41d1a3534c56e3a4ccda Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1882220694 Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:10:06.410020 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:10:06.411746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_48bc1d636aba41d1a3534c56e3a4ccda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/48bc1d636aba41d1a3534c56e3a4ccda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/48bc1d636aba41d1a3534c56e3a4ccda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/48bc1d636aba41d1a3534c56e3a4ccda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:10:06.411746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-VolumesSnapshotTestJSON-1882220694 Jun 02 14:10:06.411746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 48bc1d636aba41d1a3534c56e3a4ccda Jun 02 14:10:06.411746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1882220694 Jun 02 14:10:06.411746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-VolumesSnapshotTestJSON-1882220694-project Jun 02 14:10:06.411746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:10:06.411746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:10:06.411746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 36ce0ba640c045118116e1b68c4f3e63 Jun 02 14:10:06.411746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-VolumesSnapshotTestJSON-1882220694-project Jun 02 14:10:06.411746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:10:06.411746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance afbaac83-7a31-4b52-b437-932af9997a72 could not be found. Jun 02 14:10:06.411746 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': 'afbaac83-7a31-4b52-b437-932af9997a72'} Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afbaac83-7a31-4b52-b437-932af9997a72 could not be found. Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:10:06.412885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afbaac83-7a31-4b52-b437-932af9997a72 could not be found. Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afbaac83-7a31-4b52-b437-932af9997a72 could not be found. Jun 02 14:10:06.414993 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:10:06.416480 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0994f44a-15a6-4e6d-bbf5-c2be6b0f90ab tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Returning 404 to user: Instance afbaac83-7a31-4b52-b437-932af9997a72 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:10:06.416480 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0994f44a-15a6-4e6d-bbf5-c2be6b0f90ab tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72" status: 404 len: 111 microversion: 2.1 time: 0.030159 Jun 02 14:10:06.416480 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 594/1211] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:06 2022] GET /compute/v2.1/servers/afbaac83-7a31-4b52-b437-932af9997a72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:10:18.964990 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1283734654", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "networks": [{"uuid": "72085b90-9d86-4bc8-9080-4b69c4bc992d"}]}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:10:18.972745 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=27 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:18.973413 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:19.018594 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.network.neutron [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] validate_networks() for [('72085b90-9d86-4bc8-9080-4b69c4bc992d', None, None, None, None, None)] {{(pid=118316) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 14:10:19.370415 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Flavor limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 14:10:19.370838 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Image limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 14:10:19.371310 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Flavor pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 14:10:19.371716 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Image pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 14:10:19.372125 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 14:10:19.381002 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:19.381447 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:19.382262 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:19.382695 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:19.399938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Getting quotas for project 48bc1d636aba41d1a3534c56e3a4ccda. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:10:19.403959 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Getting quotas for user 36ce0ba640c045118116e1b68c4f3e63 and project 48bc1d636aba41d1a3534c56e3a4ccda. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:10:19.415267 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Going to run 1 instances... {{(pid=118316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 14:10:19.418193 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 14:10:19.550182 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-bd4a4e06-3079-428a-96ee-bc30a32eb107 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589038 Jun 02 14:10:19.552366 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 618/1212] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 14:10:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 14:10:19.561049 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-92b8634c-443a-405a-bfef-a3da6980390f tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:19.561754 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-92b8634c-443a-405a-bfef-a3da6980390f tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:19.564534 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:19.566243 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:19.619949 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-92b8634c-443a-405a-bfef-a3da6980390f tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:19.627402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-92b8634c-443a-405a-bfef-a3da6980390f tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1219 microversion: 2.1 time: 0.070500 Jun 02 14:10:19.627970 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 595/1213] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:19 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:20.644962 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-21ddaacc-3969-43e5-8f2c-31b89b598ba5 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:20.645508 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-21ddaacc-3969-43e5-8f2c-31b89b598ba5 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:20.651767 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21ddaacc-3969-43e5-8f2c-31b89b598ba5 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:20.652362 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21ddaacc-3969-43e5-8f2c-31b89b598ba5 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:20.653185 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21ddaacc-3969-43e5-8f2c-31b89b598ba5 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:20.653624 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-21ddaacc-3969-43e5-8f2c-31b89b598ba5 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:20.714792 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-21ddaacc-3969-43e5-8f2c-31b89b598ba5 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:20.722462 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-21ddaacc-3969-43e5-8f2c-31b89b598ba5 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1223 microversion: 2.1 time: 0.081949 Jun 02 14:10:20.723029 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 619/1214] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:20 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:21.740471 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-53a28542-f724-4e19-8824-72d260f8cd18 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:21.741095 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-53a28542-f724-4e19-8824-72d260f8cd18 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:21.750252 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-53a28542-f724-4e19-8824-72d260f8cd18 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:21.750704 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-53a28542-f724-4e19-8824-72d260f8cd18 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:21.751510 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-53a28542-f724-4e19-8824-72d260f8cd18 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:21.751944 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-53a28542-f724-4e19-8824-72d260f8cd18 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:21.816012 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-53a28542-f724-4e19-8824-72d260f8cd18 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:21.823966 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-53a28542-f724-4e19-8824-72d260f8cd18 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1271 microversion: 2.1 time: 0.087833 Jun 02 14:10:21.824549 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 596/1215] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:21 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:22.841603 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ad13ca7e-a97e-4047-8b7f-c64902484450 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:22.842285 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ad13ca7e-a97e-4047-8b7f-c64902484450 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:22.848955 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ad13ca7e-a97e-4047-8b7f-c64902484450 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:22.849411 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ad13ca7e-a97e-4047-8b7f-c64902484450 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:22.850146 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ad13ca7e-a97e-4047-8b7f-c64902484450 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:22.850572 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ad13ca7e-a97e-4047-8b7f-c64902484450 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:22.980445 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-ad13ca7e-a97e-4047-8b7f-c64902484450 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:22.987886 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ad13ca7e-a97e-4047-8b7f-c64902484450 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1319 microversion: 2.1 time: 0.150826 Jun 02 14:10:22.988534 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 620/1216] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:22 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:23.685323 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-38858085-af6e-490c-98ae-fb5d91f615be req-10f0dc10-de91-42b8-94b2-b7e458d6b10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b8c423-8c0c-4a2d-8ec1-deb07918955a", "tag": "0b2555ad-07a5-486a-adcb-0f8830c80b08"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:10:23.695231 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-38858085-af6e-490c-98ae-fb5d91f615be req-10f0dc10-de91-42b8-94b2-b7e458d6b10f service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:23.695701 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-38858085-af6e-490c-98ae-fb5d91f615be req-10f0dc10-de91-42b8-94b2-b7e458d6b10f service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:23.708819 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-38858085-af6e-490c-98ae-fb5d91f615be req-10f0dc10-de91-42b8-94b2-b7e458d6b10f service nova] Creating event network-changed:0b2555ad-07a5-486a-adcb-0f8830c80b08 for instance 11b8c423-8c0c-4a2d-8ec1-deb07918955a on hv-cinder-82651 Jun 02 14:10:23.714643 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-38858085-af6e-490c-98ae-fb5d91f615be req-10f0dc10-de91-42b8-94b2-b7e458d6b10f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033378 Jun 02 14:10:23.715245 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 597/1217] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:10:24.005573 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-42a5275d-f530-4e2c-b12e-7c8362792019 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:24.006186 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-42a5275d-f530-4e2c-b12e-7c8362792019 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:24.013921 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-42a5275d-f530-4e2c-b12e-7c8362792019 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:24.014363 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-42a5275d-f530-4e2c-b12e-7c8362792019 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:24.015129 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-42a5275d-f530-4e2c-b12e-7c8362792019 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:24.015560 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-42a5275d-f530-4e2c-b12e-7c8362792019 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:24.154394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-42a5275d-f530-4e2c-b12e-7c8362792019 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:24.162499 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-42a5275d-f530-4e2c-b12e-7c8362792019 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1319 microversion: 2.1 time: 0.160838 Jun 02 14:10:24.163067 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 621/1218] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:24 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:10:25.180162 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-21e4f44f-cc57-4fb4-8a4c-3d0ae40d895c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:25.180795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-21e4f44f-cc57-4fb4-8a4c-3d0ae40d895c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:25.187666 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-21e4f44f-cc57-4fb4-8a4c-3d0ae40d895c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:25.188115 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-21e4f44f-cc57-4fb4-8a4c-3d0ae40d895c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:25.188906 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-21e4f44f-cc57-4fb4-8a4c-3d0ae40d895c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:25.189339 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-21e4f44f-cc57-4fb4-8a4c-3d0ae40d895c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:25.327848 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-21e4f44f-cc57-4fb4-8a4c-3d0ae40d895c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:25.335722 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-21e4f44f-cc57-4fb4-8a4c-3d0ae40d895c tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1319 microversion: 2.1 time: 0.160419 Jun 02 14:10:25.336391 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 598/1219] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:25 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:26.352953 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c41c9c6a-0f02-4208-97fb-35798f66fcfb tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:26.353578 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c41c9c6a-0f02-4208-97fb-35798f66fcfb tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:26.360732 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c41c9c6a-0f02-4208-97fb-35798f66fcfb tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:26.361176 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c41c9c6a-0f02-4208-97fb-35798f66fcfb tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:26.362099 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c41c9c6a-0f02-4208-97fb-35798f66fcfb tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:26.362529 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c41c9c6a-0f02-4208-97fb-35798f66fcfb tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:26.497427 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c41c9c6a-0f02-4208-97fb-35798f66fcfb tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:26.504875 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c41c9c6a-0f02-4208-97fb-35798f66fcfb tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1319 microversion: 2.1 time: 0.155684 Jun 02 14:10:26.505449 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 622/1220] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:26 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:27.524812 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7c38e45f-bf40-49ba-99f1-e27c592f4887 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:27.525597 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7c38e45f-bf40-49ba-99f1-e27c592f4887 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:27.532012 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7c38e45f-bf40-49ba-99f1-e27c592f4887 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:27.532491 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7c38e45f-bf40-49ba-99f1-e27c592f4887 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:27.533256 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7c38e45f-bf40-49ba-99f1-e27c592f4887 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:27.533692 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7c38e45f-bf40-49ba-99f1-e27c592f4887 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:27.678787 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-7c38e45f-bf40-49ba-99f1-e27c592f4887 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:27.687025 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7c38e45f-bf40-49ba-99f1-e27c592f4887 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1319 microversion: 2.1 time: 0.166082 Jun 02 14:10:27.687598 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 599/1221] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:27 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:28.703620 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-48db6fb4-cee7-4ad6-8029-e37acf3582d3 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:28.704258 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-48db6fb4-cee7-4ad6-8029-e37acf3582d3 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:28.710985 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-48db6fb4-cee7-4ad6-8029-e37acf3582d3 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:28.717517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-48db6fb4-cee7-4ad6-8029-e37acf3582d3 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:28.717517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-48db6fb4-cee7-4ad6-8029-e37acf3582d3 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:28.717517 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-48db6fb4-cee7-4ad6-8029-e37acf3582d3 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:28.852391 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-48db6fb4-cee7-4ad6-8029-e37acf3582d3 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:28.860520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-48db6fb4-cee7-4ad6-8029-e37acf3582d3 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1319 microversion: 2.1 time: 0.160652 Jun 02 14:10:28.870319 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 623/1222] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:28 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:29.878171 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-d68b10b9-ac00-4528-b320-7fdc39fd774e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:29.878801 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-d68b10b9-ac00-4528-b320-7fdc39fd774e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:29.880976 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=2 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:29.886421 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d68b10b9-ac00-4528-b320-7fdc39fd774e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:29.886857 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d68b10b9-ac00-4528-b320-7fdc39fd774e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:29.887601 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d68b10b9-ac00-4528-b320-7fdc39fd774e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:29.888024 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-d68b10b9-ac00-4528-b320-7fdc39fd774e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:30.019491 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-d68b10b9-ac00-4528-b320-7fdc39fd774e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:30.027203 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-d68b10b9-ac00-4528-b320-7fdc39fd774e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1319 microversion: 2.1 time: 0.153108 Jun 02 14:10:30.027767 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 600/1223] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:29 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:31.044119 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-554fe243-625a-43d5-bb17-d009d9c58978 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:31.044753 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-554fe243-625a-43d5-bb17-d009d9c58978 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:31.046751 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:31.047582 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=6 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:31.052965 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-554fe243-625a-43d5-bb17-d009d9c58978 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:31.053405 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-554fe243-625a-43d5-bb17-d009d9c58978 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:31.054213 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-554fe243-625a-43d5-bb17-d009d9c58978 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:31.054640 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-554fe243-625a-43d5-bb17-d009d9c58978 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:31.199876 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-554fe243-625a-43d5-bb17-d009d9c58978 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:31.204736 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-554fe243-625a-43d5-bb17-d009d9c58978 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1319 microversion: 2.1 time: 0.164986 Jun 02 14:10:31.205974 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 624/1224] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:31 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:31.591493 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-05745f23-3e0d-4319-90d0-c0b8a067ba77 req-efbea46d-7269-4e9d-8322-65ae1b428f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b8c423-8c0c-4a2d-8ec1-deb07918955a", "name": "network-vif-plugged", "status": "completed", "tag": "0b2555ad-07a5-486a-adcb-0f8830c80b08"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:10:31.600735 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-05745f23-3e0d-4319-90d0-c0b8a067ba77 req-efbea46d-7269-4e9d-8322-65ae1b428f3e service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:31.601275 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-05745f23-3e0d-4319-90d0-c0b8a067ba77 req-efbea46d-7269-4e9d-8322-65ae1b428f3e service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:31.617464 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-05745f23-3e0d-4319-90d0-c0b8a067ba77 req-efbea46d-7269-4e9d-8322-65ae1b428f3e service nova] Creating event network-vif-plugged:0b2555ad-07a5-486a-adcb-0f8830c80b08 for instance 11b8c423-8c0c-4a2d-8ec1-deb07918955a on hv-cinder-82651 Jun 02 14:10:31.622860 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-05745f23-3e0d-4319-90d0-c0b8a067ba77 req-efbea46d-7269-4e9d-8322-65ae1b428f3e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159514 Jun 02 14:10:31.623595 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 601/1225] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:10:32.221648 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-2678ab10-8f4a-47b6-87e1-cb3befa254ff tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:32.222357 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-2678ab10-8f4a-47b6-87e1-cb3befa254ff tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:32.228889 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2678ab10-8f4a-47b6-87e1-cb3befa254ff tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:32.229518 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2678ab10-8f4a-47b6-87e1-cb3befa254ff tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:32.230295 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2678ab10-8f4a-47b6-87e1-cb3befa254ff tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:32.230711 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-2678ab10-8f4a-47b6-87e1-cb3befa254ff tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:32.362340 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-2678ab10-8f4a-47b6-87e1-cb3befa254ff tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:32.370319 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-2678ab10-8f4a-47b6-87e1-cb3befa254ff tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1319 microversion: 2.1 time: 0.152783 Jun 02 14:10:32.371440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 625/1226] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:32 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:33.388788 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-5336a671-ccdd-44d3-b109-4ab149ccb17a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:33.389387 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-5336a671-ccdd-44d3-b109-4ab149ccb17a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:33.395436 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5336a671-ccdd-44d3-b109-4ab149ccb17a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:33.395883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5336a671-ccdd-44d3-b109-4ab149ccb17a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:33.396691 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5336a671-ccdd-44d3-b109-4ab149ccb17a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:33.397119 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-5336a671-ccdd-44d3-b109-4ab149ccb17a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:33.531909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-5336a671-ccdd-44d3-b109-4ab149ccb17a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:33.539253 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-5336a671-ccdd-44d3-b109-4ab149ccb17a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1319 microversion: 2.1 time: 0.155877 Jun 02 14:10:33.539813 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 602/1227] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:33 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:34.555764 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-b6a18cc8-e699-4b13-b80e-36fecf2c779d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:10:34.556382 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-b6a18cc8-e699-4b13-b80e-36fecf2c779d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:34.563384 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b6a18cc8-e699-4b13-b80e-36fecf2c779d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:34.563831 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b6a18cc8-e699-4b13-b80e-36fecf2c779d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:34.564634 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b6a18cc8-e699-4b13-b80e-36fecf2c779d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:34.565421 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-b6a18cc8-e699-4b13-b80e-36fecf2c779d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:34.696972 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-b6a18cc8-e699-4b13-b80e-36fecf2c779d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:10:34.705187 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-b6a18cc8-e699-4b13-b80e-36fecf2c779d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1507 microversion: 2.1 time: 0.153448 Jun 02 14:10:34.705766 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 626/1228] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:10:34 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:10:34.721496 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-40f1582d-b2bb-42bd-84c3-7b08acf94b61 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83cae9b3-ade3-49fe-9967-de943a6747f0", "device": "/dev/sdb"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:10:34.722597 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-40f1582d-b2bb-42bd-84c3-7b08acf94b61 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:10:34.729004 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-40f1582d-b2bb-42bd-84c3-7b08acf94b61 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:34.729477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-40f1582d-b2bb-42bd-84c3-7b08acf94b61 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:34.730441 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-40f1582d-b2bb-42bd-84c3-7b08acf94b61 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:10:34.731415 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-40f1582d-b2bb-42bd-84c3-7b08acf94b61 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:10:35.612117 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-40f1582d-b2bb-42bd-84c3-7b08acf94b61 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "POST /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.894256 Jun 02 14:10:35.612881 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 603/1229] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 2 14:10:34 2022] POST /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a/os-volume_attachments => generated 194 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:10:41.900109 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:10:41.900846 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Thu Jun 2 14:10:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:11:14.289500 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-40240b03-88e8-4af5-adf9-00521782bf2e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:11:14.290462 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-40240b03-88e8-4af5-adf9-00521782bf2e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:11:14.292924 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:14.293719 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=50 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:14.298894 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-40240b03-88e8-4af5-adf9-00521782bf2e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:14.299330 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-40240b03-88e8-4af5-adf9-00521782bf2e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:14.300130 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-40240b03-88e8-4af5-adf9-00521782bf2e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:14.308171 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-40240b03-88e8-4af5-adf9-00521782bf2e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:14.387827 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-40240b03-88e8-4af5-adf9-00521782bf2e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lazy-loading 'services' on Instance uuid 11b8c423-8c0c-4a2d-8ec1-deb07918955a {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:11:14.600596 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-40240b03-88e8-4af5-adf9-00521782bf2e tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "DELETE /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a/os-volume_attachments/83cae9b3-ade3-49fe-9967-de943a6747f0" status: 202 len: 0 microversion: 2.1 time: 0.315018 Jun 02 14:11:14.601235 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 627/1230] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 2 14:11:14 2022] DELETE /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a/os-volume_attachments/83cae9b3-ade3-49fe-9967-de943a6747f0 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:11:16.869482 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=20 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:16.870242 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:16.874610 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c8c58a70-ccea-4a46-8887-a013c40f880d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:11:16.875199 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c8c58a70-ccea-4a46-8887-a013c40f880d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:11:16.881515 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c8c58a70-ccea-4a46-8887-a013c40f880d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:16.881968 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c8c58a70-ccea-4a46-8887-a013c40f880d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:16.882731 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c8c58a70-ccea-4a46-8887-a013c40f880d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:16.883162 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-c8c58a70-ccea-4a46-8887-a013c40f880d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:16.909262 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-c8c58a70-ccea-4a46-8887-a013c40f880d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Going to try to terminate instance {{(pid=118315) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:11:17.209691 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c8c58a70-ccea-4a46-8887-a013c40f880d tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "DELETE /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 204 len: 0 microversion: 2.1 time: 0.342039 Jun 02 14:11:17.210311 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 604/1231] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:11:16 2022] DELETE /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:11:17.219547 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-769f2bba-c262-4f8b-903b-d78e31715fbc tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:11:17.220325 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-769f2bba-c262-4f8b-903b-d78e31715fbc tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:11:17.227095 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-769f2bba-c262-4f8b-903b-d78e31715fbc tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:17.227538 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-769f2bba-c262-4f8b-903b-d78e31715fbc tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:17.228931 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-769f2bba-c262-4f8b-903b-d78e31715fbc tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:17.229364 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-769f2bba-c262-4f8b-903b-d78e31715fbc tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:17.366506 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-769f2bba-c262-4f8b-903b-d78e31715fbc tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:11:17.375020 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-769f2bba-c262-4f8b-903b-d78e31715fbc tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1513 microversion: 2.1 time: 0.159616 Jun 02 14:11:17.375650 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 628/1232] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:11:17 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:11:18.395133 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-3d829717-4380-4ca0-aebc-554d60c09f7a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:11:18.395830 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-3d829717-4380-4ca0-aebc-554d60c09f7a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:11:18.403956 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3d829717-4380-4ca0-aebc-554d60c09f7a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:18.404418 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3d829717-4380-4ca0-aebc-554d60c09f7a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:18.405280 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3d829717-4380-4ca0-aebc-554d60c09f7a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:18.405717 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-3d829717-4380-4ca0-aebc-554d60c09f7a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:18.549900 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-3d829717-4380-4ca0-aebc-554d60c09f7a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:11:18.558592 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-3d829717-4380-4ca0-aebc-554d60c09f7a tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1513 microversion: 2.1 time: 0.167663 Jun 02 14:11:18.559183 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 605/1233] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:11:18 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:11:19.576133 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e8a91e74-e600-4778-b3db-61678da7a802 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:11:19.576758 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e8a91e74-e600-4778-b3db-61678da7a802 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:11:19.583137 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e8a91e74-e600-4778-b3db-61678da7a802 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:19.583570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e8a91e74-e600-4778-b3db-61678da7a802 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:19.584309 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e8a91e74-e600-4778-b3db-61678da7a802 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:19.584763 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e8a91e74-e600-4778-b3db-61678da7a802 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:19.718327 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-e8a91e74-e600-4778-b3db-61678da7a802 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:11:19.725914 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e8a91e74-e600-4778-b3db-61678da7a802 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1513 microversion: 2.1 time: 0.154362 Jun 02 14:11:19.726481 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 629/1234] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:11:19 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:11:20.491350 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-f12687d7-11ea-4fab-ba17-dfd627f3ab12 req-317f16a2-cf53-409b-af67-1e948313f381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b8c423-8c0c-4a2d-8ec1-deb07918955a", "name": "network-vif-deleted", "tag": "0b2555ad-07a5-486a-adcb-0f8830c80b08"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:11:20.505940 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-f12687d7-11ea-4fab-ba17-dfd627f3ab12 req-317f16a2-cf53-409b-af67-1e948313f381 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:20.506709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-f12687d7-11ea-4fab-ba17-dfd627f3ab12 req-317f16a2-cf53-409b-af67-1e948313f381 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:20.519150 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-f12687d7-11ea-4fab-ba17-dfd627f3ab12 req-317f16a2-cf53-409b-af67-1e948313f381 service nova] Creating event network-vif-deleted:0b2555ad-07a5-486a-adcb-0f8830c80b08 for instance 11b8c423-8c0c-4a2d-8ec1-deb07918955a on hv-cinder-82651 Jun 02 14:11:20.524652 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-f12687d7-11ea-4fab-ba17-dfd627f3ab12 req-317f16a2-cf53-409b-af67-1e948313f381 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158907 Jun 02 14:11:20.525738 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 606/1235] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:11:20.744885 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f793d71f-8f00-479d-bb61-b6b7e5ca2864 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:11:20.745791 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f793d71f-8f00-479d-bb61-b6b7e5ca2864 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:11:20.758005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f793d71f-8f00-479d-bb61-b6b7e5ca2864 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:20.758005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f793d71f-8f00-479d-bb61-b6b7e5ca2864 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:20.758005 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f793d71f-8f00-479d-bb61-b6b7e5ca2864 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:20.758415 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f793d71f-8f00-479d-bb61-b6b7e5ca2864 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:20.789649 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f793d71f-8f00-479d-bb61-b6b7e5ca2864 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:20.790097 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f793d71f-8f00-479d-bb61-b6b7e5ca2864 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:20.791054 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-f793d71f-8f00-479d-bb61-b6b7e5ca2864 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lazy-loading 'fault' on Instance uuid 11b8c423-8c0c-4a2d-8ec1-deb07918955a {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:11:20.832697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f793d71f-8f00-479d-bb61-b6b7e5ca2864 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36ce0ba640c045118116e1b68c4f3e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc1d636aba41d1a3534c56e3a4ccda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:11:20.841785 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f793d71f-8f00-479d-bb61-b6b7e5ca2864 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 200 len: 1309 microversion: 2.1 time: 0.102329 Jun 02 14:11:20.842356 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 630/1236] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:11:20 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:11:21.858752 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f7b86a0d-16b9-4553-b2d6-030be5a7d0f0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:11:21.859462 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f7b86a0d-16b9-4553-b2d6-030be5a7d0f0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] [instance: 11b8c423-8c0c-4a2d-8ec1-deb07918955a] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:11:21.866095 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f7b86a0d-16b9-4553-b2d6-030be5a7d0f0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:21.866580 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f7b86a0d-16b9-4553-b2d6-030be5a7d0f0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:21.867396 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f7b86a0d-16b9-4553-b2d6-030be5a7d0f0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:11:21.867832 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f7b86a0d-16b9-4553-b2d6-030be5a7d0f0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:11:21.882033 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-f7b86a0d-16b9-4553-b2d6-030be5a7d0f0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] HTTP exception thrown: Instance 11b8c423-8c0c-4a2d-8ec1-deb07918955a could not be found. Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f7b86a0d-16b9-4553-b2d6-030be5a7d0f0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Request method failure captured: Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a HTTP/1.1 Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMRapZOReXKjliFb6ALs3FMo8h-T0Kj9iSxi5VvaPk1x3w-B1oQFOhIj0ER3RiUvCOBAEtgbaWuLPoXPAnFCCaI5KYrcIkNVDy_zH6_q0uz0mUmrC1pH094mZeKc0nNac78uaTLC4N6USCmnSZMqKA69yVSPL4MDVr8Mmb3PBcfVwVo Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 48bc1d636aba41d1a3534c56e3a4ccda Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1882220694 Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:11:21.883646 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:11:21.886148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_48bc1d636aba41d1a3534c56e3a4ccda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/48bc1d636aba41d1a3534c56e3a4ccda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/48bc1d636aba41d1a3534c56e3a4ccda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/48bc1d636aba41d1a3534c56e3a4ccda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:11:21.886148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-VolumesSnapshotTestJSON-1882220694 Jun 02 14:11:21.886148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 48bc1d636aba41d1a3534c56e3a4ccda Jun 02 14:11:21.886148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1882220694 Jun 02 14:11:21.886148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-VolumesSnapshotTestJSON-1882220694-project Jun 02 14:11:21.886148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:11:21.886148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:11:21.886148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 36ce0ba640c045118116e1b68c4f3e63 Jun 02 14:11:21.886148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-VolumesSnapshotTestJSON-1882220694-project Jun 02 14:11:21.886148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:11:21.886148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance 11b8c423-8c0c-4a2d-8ec1-deb07918955a could not be found. Jun 02 14:11:21.886148 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '11b8c423-8c0c-4a2d-8ec1-deb07918955a'} Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b8c423-8c0c-4a2d-8ec1-deb07918955a could not be found. Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:11:21.887149 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b8c423-8c0c-4a2d-8ec1-deb07918955a could not be found. Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b8c423-8c0c-4a2d-8ec1-deb07918955a could not be found. Jun 02 14:11:21.888803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:11:21.890275 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f7b86a0d-16b9-4553-b2d6-030be5a7d0f0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] Returning 404 to user: Instance 11b8c423-8c0c-4a2d-8ec1-deb07918955a could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:11:21.890275 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f7b86a0d-16b9-4553-b2d6-030be5a7d0f0 tempest-VolumesSnapshotTestJSON-1882220694 tempest-VolumesSnapshotTestJSON-1882220694-project] 10.222.0.33 "GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a" status: 404 len: 111 microversion: 2.1 time: 0.031297 Jun 02 14:11:21.896626 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 607/1237] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:11:21 2022] GET /compute/v2.1/servers/11b8c423-8c0c-4a2d-8ec1-deb07918955a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:12:19.745807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-eaee2b6f-1087-454c-9106-86d7f6c595bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:19.746477 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-eaee2b6f-1087-454c-9106-86d7f6c595bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:19.748464 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=10 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:19.749109 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:19.754292 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eaee2b6f-1087-454c-9106-86d7f6c595bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:19.754807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eaee2b6f-1087-454c-9106-86d7f6c595bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:19.755590 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eaee2b6f-1087-454c-9106-86d7f6c595bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:19.755987 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-eaee2b6f-1087-454c-9106-86d7f6c595bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:19.785833 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-eaee2b6f-1087-454c-9106-86d7f6c595bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/ips" status: 200 len: 145 microversion: 2.1 time: 0.043773 Jun 02 14:12:19.791477 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 631/1238] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 2 14:12:19 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:12:22.600395 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:22.601221 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:22.605369 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-48990017-ee7d-4ad2-9184-0ec79e9b9507 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d652d907-4a33-4ae2-b692-91f288b13c50"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:12:22.606416 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-48990017-ee7d-4ad2-9184-0ec79e9b9507 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:22.612201 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-48990017-ee7d-4ad2-9184-0ec79e9b9507 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:22.612697 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-48990017-ee7d-4ad2-9184-0ec79e9b9507 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:22.614640 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-48990017-ee7d-4ad2-9184-0ec79e9b9507 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:22.615074 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-48990017-ee7d-4ad2-9184-0ec79e9b9507 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:23.039529 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:12:23.040083 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Thu Jun 2 14:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:12:23.405756 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-48990017-ee7d-4ad2-9184-0ec79e9b9507 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "POST /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.806835 Jun 02 14:12:23.406389 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 608/1239] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 2 14:12:22 2022] POST /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments => generated 194 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:12:32.338502 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ea8de56d-9c96-46ab-963b-b7a4f5540ec2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:32.339483 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-ea8de56d-9c96-46ab-963b-b7a4f5540ec2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:32.346915 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ea8de56d-9c96-46ab-963b-b7a4f5540ec2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:32.351372 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ea8de56d-9c96-46ab-963b-b7a4f5540ec2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:32.351372 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ea8de56d-9c96-46ab-963b-b7a4f5540ec2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:32.351372 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-ea8de56d-9c96-46ab-963b-b7a4f5540ec2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:32.377836 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ea8de56d-9c96-46ab-963b-b7a4f5540ec2 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Jun 02 14:12:32.378384 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 632/1240] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:12:32 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:12:32.389559 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-52d0deee-8761-4ff9-a8e9-10bbfcf2ff7e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:32.390139 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-52d0deee-8761-4ff9-a8e9-10bbfcf2ff7e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:32.396998 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-52d0deee-8761-4ff9-a8e9-10bbfcf2ff7e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:32.397437 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-52d0deee-8761-4ff9-a8e9-10bbfcf2ff7e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:32.398207 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-52d0deee-8761-4ff9-a8e9-10bbfcf2ff7e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:32.398614 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-52d0deee-8761-4ff9-a8e9-10bbfcf2ff7e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:32.427351 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-52d0deee-8761-4ff9-a8e9-10bbfcf2ff7e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments/d652d907-4a33-4ae2-b692-91f288b13c50" status: 200 len: 194 microversion: 2.1 time: 0.042209 Jun 02 14:12:32.427922 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 609/1241] 10.222.0.33 () {58 vars in 1412 bytes} [Thu Jun 2 14:12:32 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments/d652d907-4a33-4ae2-b692-91f288b13c50 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:12:35.171443 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-82240cc0-06c7-4239-a3fb-c5e722a1cfbc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86a73e5d-aaba-4a5b-a13a-9e5dc0049d25"}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:12:35.172509 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-82240cc0-06c7-4239-a3fb-c5e722a1cfbc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:35.178905 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-82240cc0-06c7-4239-a3fb-c5e722a1cfbc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:35.179345 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-82240cc0-06c7-4239-a3fb-c5e722a1cfbc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:35.180082 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-82240cc0-06c7-4239-a3fb-c5e722a1cfbc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:35.180840 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-82240cc0-06c7-4239-a3fb-c5e722a1cfbc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:36.103530 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-82240cc0-06c7-4239-a3fb-c5e722a1cfbc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "POST /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.936331 Jun 02 14:12:36.104208 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 633/1242] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 2 14:12:35 2022] POST /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments => generated 194 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:12:44.638119 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ccff9a23-94df-4b82-8656-23a873018712 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:44.639177 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ccff9a23-94df-4b82-8656-23a873018712 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:44.641713 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=4 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:44.642377 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:44.648094 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ccff9a23-94df-4b82-8656-23a873018712 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:44.648583 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ccff9a23-94df-4b82-8656-23a873018712 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:44.649353 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ccff9a23-94df-4b82-8656-23a873018712 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:44.652620 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ccff9a23-94df-4b82-8656-23a873018712 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:44.678560 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ccff9a23-94df-4b82-8656-23a873018712 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044430 Jun 02 14:12:44.679109 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 610/1243] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:12:44 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:12:44.828894 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-53fb8a8a-12e9-4ba6-8024-ba30e53dcc1d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:44.829449 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-53fb8a8a-12e9-4ba6-8024-ba30e53dcc1d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:44.836305 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-53fb8a8a-12e9-4ba6-8024-ba30e53dcc1d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:44.836786 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-53fb8a8a-12e9-4ba6-8024-ba30e53dcc1d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:44.837542 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-53fb8a8a-12e9-4ba6-8024-ba30e53dcc1d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:44.837974 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-53fb8a8a-12e9-4ba6-8024-ba30e53dcc1d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:44.866376 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-53fb8a8a-12e9-4ba6-8024-ba30e53dcc1d tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments/d652d907-4a33-4ae2-b692-91f288b13c50" status: 200 len: 194 microversion: 2.1 time: 0.042464 Jun 02 14:12:44.866964 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 634/1244] 10.222.0.33 () {58 vars in 1412 bytes} [Thu Jun 2 14:12:44 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments/d652d907-4a33-4ae2-b692-91f288b13c50 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:12:44.878009 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ff1812b9-d140-46b7-82f5-55a482bf531a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:44.879195 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ff1812b9-d140-46b7-82f5-55a482bf531a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:44.886000 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ff1812b9-d140-46b7-82f5-55a482bf531a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:44.886449 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ff1812b9-d140-46b7-82f5-55a482bf531a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:44.887206 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ff1812b9-d140-46b7-82f5-55a482bf531a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:44.887647 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ff1812b9-d140-46b7-82f5-55a482bf531a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:44.968749 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-ff1812b9-d140-46b7-82f5-55a482bf531a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lazy-loading 'services' on Instance uuid 38c22317-c373-4b44-a6b5-afe350428145 {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:12:45.196573 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ff1812b9-d140-46b7-82f5-55a482bf531a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments/d652d907-4a33-4ae2-b692-91f288b13c50" status: 202 len: 0 microversion: 2.1 time: 0.322587 Jun 02 14:12:45.197177 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 611/1245] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 2 14:12:44 2022] DELETE /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments/d652d907-4a33-4ae2-b692-91f288b13c50 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:12:47.360430 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-994dc255-eead-4605-b000-e9b6664690fd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:47.360945 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-994dc255-eead-4605-b000-e9b6664690fd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:47.368074 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-994dc255-eead-4605-b000-e9b6664690fd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:47.368560 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-994dc255-eead-4605-b000-e9b6664690fd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:47.369318 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-994dc255-eead-4605-b000-e9b6664690fd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:47.369751 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-994dc255-eead-4605-b000-e9b6664690fd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:47.398719 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-994dc255-eead-4605-b000-e9b6664690fd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments/86a73e5d-aaba-4a5b-a13a-9e5dc0049d25" status: 200 len: 194 microversion: 2.1 time: 0.042303 Jun 02 14:12:47.399287 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 635/1246] 10.222.0.33 () {58 vars in 1412 bytes} [Thu Jun 2 14:12:47 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments/86a73e5d-aaba-4a5b-a13a-9e5dc0049d25 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:12:47.409636 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-392ed4e0-6e70-4f0d-825d-e48ed2f4462b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:47.410295 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-392ed4e0-6e70-4f0d-825d-e48ed2f4462b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:47.416943 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-392ed4e0-6e70-4f0d-825d-e48ed2f4462b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:47.417316 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-392ed4e0-6e70-4f0d-825d-e48ed2f4462b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:47.418061 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-392ed4e0-6e70-4f0d-825d-e48ed2f4462b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:47.418516 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-392ed4e0-6e70-4f0d-825d-e48ed2f4462b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:47.503617 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.objects.instance [None req-392ed4e0-6e70-4f0d-825d-e48ed2f4462b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lazy-loading 'services' on Instance uuid 38c22317-c373-4b44-a6b5-afe350428145 {{(pid=118315) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:12:47.695677 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-392ed4e0-6e70-4f0d-825d-e48ed2f4462b tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments/86a73e5d-aaba-4a5b-a13a-9e5dc0049d25" status: 202 len: 0 microversion: 2.1 time: 0.290132 Jun 02 14:12:47.696267 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 612/1247] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 2 14:12:47 2022] DELETE /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments/86a73e5d-aaba-4a5b-a13a-9e5dc0049d25 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:12:48.851706 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-fe84960d-51f3-4fab-809b-74cda24fee31 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:48.852719 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-fe84960d-51f3-4fab-809b-74cda24fee31 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:48.859048 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe84960d-51f3-4fab-809b-74cda24fee31 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:48.859486 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe84960d-51f3-4fab-809b-74cda24fee31 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:48.860224 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe84960d-51f3-4fab-809b-74cda24fee31 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:48.860681 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-fe84960d-51f3-4fab-809b-74cda24fee31 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:48.889881 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-fe84960d-51f3-4fab-809b-74cda24fee31 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042029 Jun 02 14:12:48.890436 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 636/1248] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:12:48 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 14:12:48.995710 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-50f6b7fe-2b68-4a5c-be4b-740bff0bfb9a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:48.996737 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-50f6b7fe-2b68-4a5c-be4b-740bff0bfb9a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:49.002838 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-50f6b7fe-2b68-4a5c-be4b-740bff0bfb9a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:49.004051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-50f6b7fe-2b68-4a5c-be4b-740bff0bfb9a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:49.004847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-50f6b7fe-2b68-4a5c-be4b-740bff0bfb9a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:49.005289 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-50f6b7fe-2b68-4a5c-be4b-740bff0bfb9a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:49.033321 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-50f6b7fe-2b68-4a5c-be4b-740bff0bfb9a tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042274 Jun 02 14:12:49.033876 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 613/1249] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 2 14:12:48 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 14:12:49.093033 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8d250f11-333c-4bf4-a633-b0a0034a68e6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:49.093525 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8d250f11-333c-4bf4-a633-b0a0034a68e6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:49.099930 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8d250f11-333c-4bf4-a633-b0a0034a68e6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:49.100379 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8d250f11-333c-4bf4-a633-b0a0034a68e6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:49.101157 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8d250f11-333c-4bf4-a633-b0a0034a68e6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:49.101594 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8d250f11-333c-4bf4-a633-b0a0034a68e6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:49.126250 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8d250f11-333c-4bf4-a633-b0a0034a68e6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Going to try to terminate instance {{(pid=118316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:12:49.461870 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8d250f11-333c-4bf4-a633-b0a0034a68e6 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 204 len: 0 microversion: 2.1 time: 0.372446 Jun 02 14:12:49.462465 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 637/1250] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:12:49 2022] DELETE /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:12:49.470709 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-28f15d0a-d9b6-49e3-98f4-d51948b09033 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:49.471331 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-28f15d0a-d9b6-49e3-98f4-d51948b09033 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:49.478221 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-28f15d0a-d9b6-49e3-98f4-d51948b09033 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:49.478656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-28f15d0a-d9b6-49e3-98f4-d51948b09033 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:49.479517 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-28f15d0a-d9b6-49e3-98f4-d51948b09033 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:49.479954 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-28f15d0a-d9b6-49e3-98f4-d51948b09033 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:49.608516 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-28f15d0a-d9b6-49e3-98f4-d51948b09033 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:12:49.616291 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-28f15d0a-d9b6-49e3-98f4-d51948b09033 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1672 microversion: 2.1 time: 0.149550 Jun 02 14:12:49.616883 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 614/1251] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:12:49 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:12:50.634193 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-30f22ce3-b42d-4fb5-b457-045b28220638 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:50.634886 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-30f22ce3-b42d-4fb5-b457-045b28220638 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:50.641271 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-30f22ce3-b42d-4fb5-b457-045b28220638 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:50.641709 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-30f22ce3-b42d-4fb5-b457-045b28220638 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:50.642450 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-30f22ce3-b42d-4fb5-b457-045b28220638 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:50.642871 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-30f22ce3-b42d-4fb5-b457-045b28220638 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:50.775034 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-30f22ce3-b42d-4fb5-b457-045b28220638 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:12:50.782391 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-30f22ce3-b42d-4fb5-b457-045b28220638 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1672 microversion: 2.1 time: 0.152395 Jun 02 14:12:50.782942 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 638/1252] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:12:50 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:12:51.799179 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-de6a19e4-232c-48c3-af5c-db94273f1d1e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:51.800019 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-de6a19e4-232c-48c3-af5c-db94273f1d1e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:51.806848 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-de6a19e4-232c-48c3-af5c-db94273f1d1e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:51.807291 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-de6a19e4-232c-48c3-af5c-db94273f1d1e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:51.808050 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-de6a19e4-232c-48c3-af5c-db94273f1d1e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:51.808506 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-de6a19e4-232c-48c3-af5c-db94273f1d1e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:51.940302 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-de6a19e4-232c-48c3-af5c-db94273f1d1e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:12:51.948248 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-de6a19e4-232c-48c3-af5c-db94273f1d1e tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1672 microversion: 2.1 time: 0.152936 Jun 02 14:12:51.948858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 615/1253] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:12:51 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:12:52.965658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5f74a178-785c-4c0b-b8a5-e755a489b0bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:52.966356 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-5f74a178-785c-4c0b-b8a5-e755a489b0bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:52.977193 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5f74a178-785c-4c0b-b8a5-e755a489b0bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:52.977783 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5f74a178-785c-4c0b-b8a5-e755a489b0bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:52.979077 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5f74a178-785c-4c0b-b8a5-e755a489b0bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:52.979570 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-5f74a178-785c-4c0b-b8a5-e755a489b0bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:53.017395 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-f5a1db9a-8078-4d86-abfc-bbde8164294e req-7bcc1f0f-7b4b-40be-9c49-ca21a77a47e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c22317-c373-4b44-a6b5-afe350428145", "name": "network-vif-deleted", "tag": "6e88a7f3-57a4-44c6-9d5e-feaf2a0c613f"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:12:53.027912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-f5a1db9a-8078-4d86-abfc-bbde8164294e req-7bcc1f0f-7b4b-40be-9c49-ca21a77a47e5 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:53.028729 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-f5a1db9a-8078-4d86-abfc-bbde8164294e req-7bcc1f0f-7b4b-40be-9c49-ca21a77a47e5 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:53.045504 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-f5a1db9a-8078-4d86-abfc-bbde8164294e req-7bcc1f0f-7b4b-40be-9c49-ca21a77a47e5 service nova] Creating event network-vif-deleted:6e88a7f3-57a4-44c6-9d5e-feaf2a0c613f for instance 38c22317-c373-4b44-a6b5-afe350428145 on hv-cinder-82651 Jun 02 14:12:53.047139 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-5f74a178-785c-4c0b-b8a5-e755a489b0bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e78feea3104797a5e927c8ffb76d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:12:53.047732 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-f5a1db9a-8078-4d86-abfc-bbde8164294e req-7bcc1f0f-7b4b-40be-9c49-ca21a77a47e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033875 Jun 02 14:12:53.048952 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 616/1254] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:12:53.056107 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5f74a178-785c-4c0b-b8a5-e755a489b0bd tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 200 len: 1605 microversion: 2.1 time: 0.094333 Jun 02 14:12:53.056697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 639/1255] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:12:52 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 1605 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:12:54.074057 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-59196191-6520-4fd0-82dd-5a119102d907 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:54.074847 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-59196191-6520-4fd0-82dd-5a119102d907 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:54.081638 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-59196191-6520-4fd0-82dd-5a119102d907 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:54.082088 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-59196191-6520-4fd0-82dd-5a119102d907 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:54.082863 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-59196191-6520-4fd0-82dd-5a119102d907 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:54.083298 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-59196191-6520-4fd0-82dd-5a119102d907 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:54.096658 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-59196191-6520-4fd0-82dd-5a119102d907 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] HTTP exception thrown: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-59196191-6520-4fd0-82dd-5a119102d907 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Request method failure captured: Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 HTTP/1.1 Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimML4fRmfNYbmwK2CbDO5VOUE--ocSTsH77P9BhtEgdV-xQWZfyOCbqiySDst1bX2_FNbh-p2y0rVBKY1cNGf35FO010zDID8RuLsAhcjJNPAiLQNow3mC9U8H5Lz2ZxvZl-0eIirxbqLRSIILPIug6L8aXD-_-BbrwIf9ll0u2k_LyY Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: fbb232ab0a2347dea2fa82e1cdbf24b5 Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:12:54.098296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:12:54.100070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:12:54.100070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:54.100070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: fbb232ab0a2347dea2fa82e1cdbf24b5 Jun 02 14:12:54.100070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:54.100070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeTestJSON-676059352-project Jun 02 14:12:54.100070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:12:54.100070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:12:54.100070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 36e78feea3104797a5e927c8ffb76d18 Jun 02 14:12:54.100070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeTestJSON-676059352-project Jun 02 14:12:54.100070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:12:54.100070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:54.100070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '38c22317-c373-4b44-a6b5-afe350428145'} Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:12:54.101110 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:54.103013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:54.104814 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-59196191-6520-4fd0-82dd-5a119102d907 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Returning 404 to user: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:12:54.104814 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-59196191-6520-4fd0-82dd-5a119102d907 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 404 len: 111 microversion: 2.1 time: 0.029934 Jun 02 14:12:54.104814 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 617/1256] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:12:54 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:12:54.108579 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-49708b6f-5864-4201-a962-d6889919a3eb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '.version_select at 0x7fb72417b3a0>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:54.205925 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-49708b6f-5864-4201-a962-d6889919a3eb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1847344968" status: 202 len: 0 microversion: 2.1 time: 0.101076 Jun 02 14:12:54.206647 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 640/1257] 10.222.0.33 () {58 vars in 1220 bytes} [Thu Jun 2 14:12:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1847344968 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:12:57.501829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1550f25b-0204-44a4-a8e8-8c20ac3149dc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:57.502324 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1550f25b-0204-44a4-a8e8-8c20ac3149dc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:57.509539 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1550f25b-0204-44a4-a8e8-8c20ac3149dc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:57.510044 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1550f25b-0204-44a4-a8e8-8c20ac3149dc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:57.510799 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1550f25b-0204-44a4-a8e8-8c20ac3149dc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:57.511231 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1550f25b-0204-44a4-a8e8-8c20ac3149dc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:57.524489 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-1550f25b-0204-44a4-a8e8-8c20ac3149dc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] HTTP exception thrown: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1550f25b-0204-44a4-a8e8-8c20ac3149dc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Request method failure captured: Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: DELETE /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 HTTP/1.1 Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimML4fRmfNYbmwK2CbDO5VOUE--ocSTsH77P9BhtEgdV-xQWZfyOCbqiySDst1bX2_FNbh-p2y0rVBKY1cNGf35FO010zDID8RuLsAhcjJNPAiLQNow3mC9U8H5Lz2ZxvZl-0eIirxbqLRSIILPIug6L8aXD-_-BbrwIf9ll0u2k_LyY Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: fbb232ab0a2347dea2fa82e1cdbf24b5 Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:12:57.526010 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:12:57.527748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:12:57.527748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:57.527748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: fbb232ab0a2347dea2fa82e1cdbf24b5 Jun 02 14:12:57.527748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:57.527748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeTestJSON-676059352-project Jun 02 14:12:57.527748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:12:57.527748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:12:57.527748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 36e78feea3104797a5e927c8ffb76d18 Jun 02 14:12:57.527748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeTestJSON-676059352-project Jun 02 14:12:57.527748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:12:57.527748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:57.527748 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '38c22317-c373-4b44-a6b5-afe350428145'} Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:12:57.528686 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:57.530045 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:57.531407 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1550f25b-0204-44a4-a8e8-8c20ac3149dc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Returning 404 to user: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:12:57.531407 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1550f25b-0204-44a4-a8e8-8c20ac3149dc tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 404 len: 111 microversion: 2.1 time: 0.029449 Jun 02 14:12:57.531407 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 618/1258] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:12:57 2022] DELETE /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:12:57.537153 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e964ba18-19f3-4406-bfcd-90766bb82db9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:57.537762 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-e964ba18-19f3-4406-bfcd-90766bb82db9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: 38c22317-c373-4b44-a6b5-afe350428145] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:57.544262 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e964ba18-19f3-4406-bfcd-90766bb82db9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:57.544727 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e964ba18-19f3-4406-bfcd-90766bb82db9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:57.545472 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e964ba18-19f3-4406-bfcd-90766bb82db9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:57.545899 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-e964ba18-19f3-4406-bfcd-90766bb82db9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:57.559246 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-e964ba18-19f3-4406-bfcd-90766bb82db9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] HTTP exception thrown: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e964ba18-19f3-4406-bfcd-90766bb82db9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Request method failure captured: Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 HTTP/1.1 Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimML4fRmfNYbmwK2CbDO5VOUE--ocSTsH77P9BhtEgdV-xQWZfyOCbqiySDst1bX2_FNbh-p2y0rVBKY1cNGf35FO010zDID8RuLsAhcjJNPAiLQNow3mC9U8H5Lz2ZxvZl-0eIirxbqLRSIILPIug6L8aXD-_-BbrwIf9ll0u2k_LyY Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: fbb232ab0a2347dea2fa82e1cdbf24b5 Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:12:57.560888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:12:57.562851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:12:57.562851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:57.562851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: fbb232ab0a2347dea2fa82e1cdbf24b5 Jun 02 14:12:57.562851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:57.562851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-AttachVolumeTestJSON-676059352-project Jun 02 14:12:57.562851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:12:57.562851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:12:57.562851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 36e78feea3104797a5e927c8ffb76d18 Jun 02 14:12:57.562851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-AttachVolumeTestJSON-676059352-project Jun 02 14:12:57.562851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:12:57.562851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:57.562851 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': '38c22317-c373-4b44-a6b5-afe350428145'} Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:12:57.563861 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. Jun 02 14:12:57.565658 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:12:57.567083 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-e964ba18-19f3-4406-bfcd-90766bb82db9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Returning 404 to user: Instance 38c22317-c373-4b44-a6b5-afe350428145 could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:12:57.567083 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-e964ba18-19f3-4406-bfcd-90766bb82db9 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145" status: 404 len: 111 microversion: 2.1 time: 0.030304 Jun 02 14:12:57.567083 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 641/1259] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:12:57 2022] GET /compute/v2.1/servers/38c22317-c373-4b44-a6b5-afe350428145 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:12:58.847094 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f16f6ec4-5c90-410c-a1e1-0e2cc7d338eb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:58.847587 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-f16f6ec4-5c90-410c-a1e1-0e2cc7d338eb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:58.854769 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f16f6ec4-5c90-410c-a1e1-0e2cc7d338eb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:58.855210 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f16f6ec4-5c90-410c-a1e1-0e2cc7d338eb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:58.855954 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f16f6ec4-5c90-410c-a1e1-0e2cc7d338eb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:58.856379 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-f16f6ec4-5c90-410c-a1e1-0e2cc7d338eb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:58.870165 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-f16f6ec4-5c90-410c-a1e1-0e2cc7d338eb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] HTTP exception thrown: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f16f6ec4-5c90-410c-a1e1-0e2cc7d338eb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Request method failure captured: Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: DELETE /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa HTTP/1.1 Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimML4fRmfNYbmwK2CbDO5VOUE--ocSTsH77P9BhtEgdV-xQWZfyOCbqiySDst1bX2_FNbh-p2y0rVBKY1cNGf35FO010zDID8RuLsAhcjJNPAiLQNow3mC9U8H5Lz2ZxvZl-0eIirxbqLRSIILPIug6L8aXD-_-BbrwIf9ll0u2k_LyY Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: fbb232ab0a2347dea2fa82e1cdbf24b5 Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:12:58.871696 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:12:58.873477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:12:58.873477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:58.873477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: fbb232ab0a2347dea2fa82e1cdbf24b5 Jun 02 14:12:58.873477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:58.873477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-AttachVolumeTestJSON-676059352-project Jun 02 14:12:58.873477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:12:58.873477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:12:58.873477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 36e78feea3104797a5e927c8ffb76d18 Jun 02 14:12:58.873477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-AttachVolumeTestJSON-676059352-project Jun 02 14:12:58.873477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:12:58.873477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:12:58.873477 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': 'e0222076-c3be-46b9-81c2-2f88404417aa'} Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:12:58.874615 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:12:58.876472 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:12:58.878128 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-f16f6ec4-5c90-410c-a1e1-0e2cc7d338eb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Returning 404 to user: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:12:58.878128 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-f16f6ec4-5c90-410c-a1e1-0e2cc7d338eb tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 404 len: 111 microversion: 2.1 time: 0.029870 Jun 02 14:12:58.878128 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 619/1260] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:12:58 2022] DELETE /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:12:58.881992 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-423bb85b-597e-429d-ab45-b750629a9c86 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:12:58.882606 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-423bb85b-597e-429d-ab45-b750629a9c86 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] [instance: e0222076-c3be-46b9-81c2-2f88404417aa] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:12:58.889741 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-423bb85b-597e-429d-ab45-b750629a9c86 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:58.890220 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-423bb85b-597e-429d-ab45-b750629a9c86 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:58.890987 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-423bb85b-597e-429d-ab45-b750629a9c86 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:12:58.891421 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-423bb85b-597e-429d-ab45-b750629a9c86 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:12:58.904556 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-423bb85b-597e-429d-ab45-b750629a9c86 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] HTTP exception thrown: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-423bb85b-597e-429d-ab45-b750629a9c86 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Request method failure captured: Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa HTTP/1.1 Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimML4fRmfNYbmwK2CbDO5VOUE--ocSTsH77P9BhtEgdV-xQWZfyOCbqiySDst1bX2_FNbh-p2y0rVBKY1cNGf35FO010zDID8RuLsAhcjJNPAiLQNow3mC9U8H5Lz2ZxvZl-0eIirxbqLRSIILPIug6L8aXD-_-BbrwIf9ll0u2k_LyY Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: fbb232ab0a2347dea2fa82e1cdbf24b5 Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:12:58.906059 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:12:58.907782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbb232ab0a2347dea2fa82e1cdbf24b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:12:58.907782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:58.907782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: fbb232ab0a2347dea2fa82e1cdbf24b5 Jun 02 14:12:58.907782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-AttachVolumeTestJSON-676059352 Jun 02 14:12:58.907782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-AttachVolumeTestJSON-676059352-project Jun 02 14:12:58.907782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:12:58.907782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:12:58.907782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 36e78feea3104797a5e927c8ffb76d18 Jun 02 14:12:58.907782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-AttachVolumeTestJSON-676059352-project Jun 02 14:12:58.907782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: > Jun 02 14:12:58.907782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:12:58.907782 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': 'e0222076-c3be-46b9-81c2-2f88404417aa'} Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:12:58.911938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. Jun 02 14:12:58.913610 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:12:58.915052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-423bb85b-597e-429d-ab45-b750629a9c86 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] Returning 404 to user: Instance e0222076-c3be-46b9-81c2-2f88404417aa could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:12:58.915052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-423bb85b-597e-429d-ab45-b750629a9c86 tempest-AttachVolumeTestJSON-676059352 tempest-AttachVolumeTestJSON-676059352-project] 10.222.0.33 "GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa" status: 404 len: 111 microversion: 2.1 time: 0.029870 Jun 02 14:12:58.915052 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 642/1261] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:12:58 2022] GET /compute/v2.1/servers/e0222076-c3be-46b9-81c2-2f88404417aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 14:13:04.289208 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2c02165b-0380-489b-8ac3-ca8285e2282d tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Action: 'create', calling method: .version_select at 0x7fb72009b160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1833650342"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:13:04.997424 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2c02165b-0380-489b-8ac3-ca8285e2282d tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.822007 Jun 02 14:13:04.998052 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 620/1262] 10.222.0.33 () {60 vars in 1154 bytes} [Thu Jun 2 14:13:04 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 823 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 02 14:13:05.010161 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-01954eaf-17df-4fe4-bf19-83964b3e7335 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb71ae40a60>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:05.061215 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-01954eaf-17df-4fe4-bf19-83964b3e7335 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c" status: 200 len: 345 microversion: 2.1 time: 0.054113 Jun 02 14:13:05.061215 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 643/1263] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 14:13:05 2022] GET /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:13:06.074366 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-61832141-b9e8-4900-a092-1e37d7fb3688 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb71adf7af0>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:06.121769 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-61832141-b9e8-4900-a092-1e37d7fb3688 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c" status: 200 len: 345 microversion: 2.1 time: 0.051704 Jun 02 14:13:06.126062 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 621/1264] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 14:13:06 2022] GET /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:13:07.135679 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8a69d6ab-97d2-42fc-8805-e98d7d09fa27 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb724110550>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:07.184770 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8a69d6ab-97d2-42fc-8805-e98d7d09fa27 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c" status: 200 len: 346 microversion: 2.1 time: 0.053246 Jun 02 14:13:07.185438 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 644/1265] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 14:13:07 2022] GET /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:13:07.198765 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c8cad010-a4f8-4a29-af11-a1a54a23e68d tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Action: 'create', calling method: .version_select at 0x7fb71adf7670>, body: {"snapshot": {"volume_id": "5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2024777339"}} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:13:07.582774 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c8cad010-a4f8-4a29-af11-a1a54a23e68d tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.389180 Jun 02 14:13:07.583446 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 622/1266] 10.222.0.33 () {60 vars in 1161 bytes} [Thu Jun 2 14:13:07 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:13:07.593352 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-11f963c9-656e-47bd-a8dd-a6e91eff9d1c tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb72417cf70>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:07.623848 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-11f963c9-656e-47bd-a8dd-a6e91eff9d1c tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f" status: 200 len: 287 microversion: 2.1 time: 0.034372 Jun 02 14:13:07.624464 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 645/1267] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 2 14:13:07 2022] GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:13:07.634695 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-c62eb1c1-3071-412c-afa5-653b89090bd1 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb72009baf0>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:07.665059 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-c62eb1c1-3071-412c-afa5-653b89090bd1 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034125 Jun 02 14:13:07.665720 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 623/1268] 10.222.0.33 () {58 vars in 1139 bytes} [Thu Jun 2 14:13:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:13:07.676932 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-5e8044bc-13e5-415c-a913-f4f38f35050f tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb72417b5e0>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:07.709421 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-5e8044bc-13e5-415c-a913-f4f38f35050f tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f" status: 200 len: 287 microversion: 2.1 time: 0.036705 Jun 02 14:13:07.709996 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 646/1269] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 2 14:13:07 2022] GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:13:08.721613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-151a4d60-2510-466b-8c68-723eb21fa0ae tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb71ad5ee50>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:08.755775 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-151a4d60-2510-466b-8c68-723eb21fa0ae tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f" status: 200 len: 287 microversion: 2.1 time: 0.038355 Jun 02 14:13:08.756656 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 624/1270] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 2 14:13:08 2022] GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:13:09.764591 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:09.765266 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:09.769094 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-9b88a907-91fe-4993-b66a-27c1dfdb7f9f tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb724128790>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:09.797941 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-9b88a907-91fe-4993-b66a-27c1dfdb7f9f tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f" status: 200 len: 287 microversion: 2.1 time: 0.034641 Jun 02 14:13:09.798557 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 647/1271] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 2 14:13:09 2022] GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:13:10.807254 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=20 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:10.807949 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=2 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:10.812553 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e5af8b6b-3e6f-47d5-9e1e-83cff991bcd8 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb71ad72f70>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:10.843350 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e5af8b6b-3e6f-47d5-9e1e-83cff991bcd8 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f" status: 200 len: 287 microversion: 2.1 time: 0.036916 Jun 02 14:13:10.843909 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 625/1272] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 2 14:13:10 2022] GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:13:11.856650 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-3c6fe5c8-654d-4375-9f5b-f64f17e6cf40 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb72417c040>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:11.861429 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:13:11.861851 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Thu Jun 2 14:13:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:13:11.887806 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-3c6fe5c8-654d-4375-9f5b-f64f17e6cf40 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f" status: 200 len: 287 microversion: 2.1 time: 0.036176 Jun 02 14:13:11.888373 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 648/1273] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 2 14:13:11 2022] GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:13:12.900500 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-752cd807-f1aa-46f7-8582-5683253bc270 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb720315310>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:12.930609 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-752cd807-f1aa-46f7-8582-5683253bc270 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f" status: 200 len: 288 microversion: 2.1 time: 0.035249 Jun 02 14:13:12.931167 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 626/1274] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 2 14:13:12 2022] GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:13:12.958601 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-6d24d90b-85ed-4f2c-b59d-de5ed6e94f91 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb71ae40a60>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:13.105039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-6d24d90b-85ed-4f2c-b59d-de5ed6e94f91 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f" status: 202 len: 0 microversion: 2.1 time: 0.151627 Jun 02 14:13:13.106691 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 649/1275] 10.222.0.33 () {58 vars in 1253 bytes} [Thu Jun 2 14:13:12 2022] DELETE /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:13:13.115237 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e6862edd-ba7e-464b-a98d-b4cecaf80c97 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb720273d30>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:13.146569 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e6862edd-ba7e-464b-a98d-b4cecaf80c97 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f" status: 200 len: 287 microversion: 2.1 time: 0.036102 Jun 02 14:13:13.147335 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 627/1276] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 2 14:13:13 2022] GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:13:14.161213 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ef2156d6-8cb1-4ad4-b3ad-d214e6d4d180 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb72417c1f0>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:14.186016 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-ef2156d6-8cb1-4ad4-b3ad-d214e6d4d180 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] HTTP exception thrown: Snapshot b2c407f9-a42d-455c-a4d7-ca129fcee43f could not be found. Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ef2156d6-8cb1-4ad4-b3ad-d214e6d4d180 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Request method failure captured: Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f HTTP/1.1 Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMVw_VXMQdtvpcHq2WFPkvgU5d7TnLfjPXadnUf2-yA7zYyWpD_CsG_ntmNYJD8N5dVZthgaSIsqlwPuZ9oSB8kmSPUXBVa986kkZe4R9zp8AhenBvdS1ks8kWqOG9PoaUXy_Yh4PmzyHoTZlQWHGrF3oyjdBmY7Kj9gir-ZaqBziUA Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 5a5815cb07604da49ba577304f08f5bc Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-454950069 Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:13:14.188520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:13:14.190298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:13:14.190298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-VolumesSnapshotsTestJSON-454950069 Jun 02 14:13:14.190298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 5a5815cb07604da49ba577304f08f5bc Jun 02 14:13:14.190298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-454950069 Jun 02 14:13:14.190298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-VolumesSnapshotsTestJSON-454950069-project Jun 02 14:13:14.190298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:13:14.190298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:13:14.190298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 9e0d58651f94465d856d180263884dec Jun 02 14:13:14.190298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-VolumesSnapshotsTestJSON-454950069-project Jun 02 14:13:14.190298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: Jun 02 14:13:14.190298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Snapshot b2c407f9-a42d-455c-a4d7-ca129fcee43f could not be found. Jun 02 14:13:14.190298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': 'b2c407f9-a42d-455c-a4d7-ca129fcee43f'} Jun 02 14:13:14.190298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b2c407f9-a42d-455c-a4d7-ca129fcee43f could not be found. (HTTP 404) (Request-ID: req-97bca179-415b-4b8f-9175-2f6f20a9f477) Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:13:14.191440 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 14:13:14.193664 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b2c407f9-a42d-455c-a4d7-ca129fcee43f could not be found. Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 02 14:13:14.195417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:13:14.197089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b2c407f9-a42d-455c-a4d7-ca129fcee43f could not be found. Jun 02 14:13:14.197089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:13:14.197089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:13:14.197089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:13:14.197089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:14.197089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:13:14.197089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:13:14.197089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:13:14.197089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:13:14.197089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b2c407f9-a42d-455c-a4d7-ca129fcee43f could not be found. Jun 02 14:13:14.197089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:13:14.197089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ef2156d6-8cb1-4ad4-b3ad-d214e6d4d180 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Returning 404 to user: Snapshot b2c407f9-a42d-455c-a4d7-ca129fcee43f could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:13:14.197089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ef2156d6-8cb1-4ad4-b3ad-d214e6d4d180 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f" status: 404 len: 111 microversion: 2.1 time: 0.033268 Jun 02 14:13:14.198193 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 650/1277] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 2 14:13:14 2022] GET /compute/v2.1/os-snapshots/b2c407f9-a42d-455c-a4d7-ca129fcee43f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:13:14.200439 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-2786d690-da56-438a-8269-b01564dc283a tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb72043c790>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:14.423295 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-2786d690-da56-438a-8269-b01564dc283a tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c" status: 202 len: 0 microversion: 2.1 time: 0.227002 Jun 02 14:13:14.423895 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 628/1278] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 2 14:13:14 2022] DELETE /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 14:13:14.433818 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-bc968ccf-ae48-40b7-905f-e7e718ff5b29 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb72417ca60>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:14.483042 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-bc968ccf-ae48-40b7-905f-e7e718ff5b29 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c" status: 200 len: 345 microversion: 2.1 time: 0.053714 Jun 02 14:13:14.483611 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 651/1279] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 14:13:14 2022] GET /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:13:15.495792 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-36a8c47a-78cb-421a-aee7-bf12b89a9467 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb720315af0>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:15.524332 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-36a8c47a-78cb-421a-aee7-bf12b89a9467 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] HTTP exception thrown: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-36a8c47a-78cb-421a-aee7-bf12b89a9467 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Request method failure captured: Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c HTTP/1.1 Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMVw_VXMQdtvpcHq2WFPkvgU5d7TnLfjPXadnUf2-yA7zYyWpD_CsG_ntmNYJD8N5dVZthgaSIsqlwPuZ9oSB8kmSPUXBVa986kkZe4R9zp8AhenBvdS1ks8kWqOG9PoaUXy_Yh4PmzyHoTZlQWHGrF3oyjdBmY7Kj9gir-ZaqBziUA Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 5a5815cb07604da49ba577304f08f5bc Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-454950069 Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:13:15.526299 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:13:15.527796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:13:15.527796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-VolumesSnapshotsTestJSON-454950069 Jun 02 14:13:15.527796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 5a5815cb07604da49ba577304f08f5bc Jun 02 14:13:15.527796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-454950069 Jun 02 14:13:15.527796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-VolumesSnapshotsTestJSON-454950069-project Jun 02 14:13:15.527796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:13:15.527796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:13:15.527796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 9e0d58651f94465d856d180263884dec Jun 02 14:13:15.527796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-VolumesSnapshotsTestJSON-454950069-project Jun 02 14:13:15.527796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: Jun 02 14:13:15.527796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.527796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c'} Jun 02 14:13:15.527796 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. (HTTP 404) (Request-ID: req-34ac807b-dcd8-4d68-bb72-d7882a9492b7) Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:13:15.528829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 14:13:15.530235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 14:13:15.531795 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:13:15.533362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.533362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.533362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:13:15.533362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.533362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:15.533362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:13:15.533362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:13:15.533362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:13:15.533362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:13:15.533362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.533362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.533362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-36a8c47a-78cb-421a-aee7-bf12b89a9467 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Returning 404 to user: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:13:15.533362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-36a8c47a-78cb-421a-aee7-bf12b89a9467 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c" status: 404 len: 109 microversion: 2.1 time: 0.036428 Jun 02 14:13:15.533362 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 629/1280] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 14:13:15 2022] GET /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:13:15.542515 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ac897ac6-4fa1-4788-a9b9-3b30368ec381 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb724147940>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:15.571092 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.wsgi [None req-ac897ac6-4fa1-4788-a9b9-3b30368ec381 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] HTTP exception thrown: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ac897ac6-4fa1-4788-a9b9-3b30368ec381 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Request method failure captured: Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: request: DELETE /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c HTTP/1.1 Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept: application/json Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Accept-Encoding: identity Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Connection: close Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Length: 0 Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Content-Type: application/json Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Host: 10.222.0.33 Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Openstack-System-Scope: None Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: User-Agent: python-urllib3/1.26.9 Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Auth-Token: gAAAAABimMVw_VXMQdtvpcHq2WFPkvgU5d7TnLfjPXadnUf2-yA7zYyWpD_CsG_ntmNYJD8N5dVZthgaSIsqlwPuZ9oSB8kmSPUXBVa986kkZe4R9zp8AhenBvdS1ks8kWqOG9PoaUXy_Yh4PmzyHoTZlQWHGrF3oyjdBmY7Kj9gir-ZaqBziUA Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Id: None Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Domain-Name: None Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Identity-Status: Confirmed Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Is-Admin-Project: True Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Id: default Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Domain-Name: Default Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Id: 5a5815cb07604da49ba577304f08f5bc Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-454950069 Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Role: reader,member Jun 02 14:13:15.573039 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Roles: reader,member Jun 02 14:13:15.574807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:13:15.574807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant: tempest-VolumesSnapshotsTestJSON-454950069 Jun 02 14:13:15.574807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Id: 5a5815cb07604da49ba577304f08f5bc Jun 02 14:13:15.574807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-454950069 Jun 02 14:13:15.574807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User: tempest-VolumesSnapshotsTestJSON-454950069-project Jun 02 14:13:15.574807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Id: default Jun 02 14:13:15.574807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Domain-Name: Default Jun 02 14:13:15.574807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Id: 9e0d58651f94465d856d180263884dec Jun 02 14:13:15.574807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: X-User-Name: tempest-VolumesSnapshotsTestJSON-454950069-project Jun 02 14:13:15.574807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: method: Jun 02 14:13:15.574807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: exception: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.574807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: action_args: {'id': '5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c'} Jun 02 14:13:15.574807 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. (HTTP 404) (Request-ID: req-08ff47c2-b27f-4757-b0e5-8c2d177e50da) Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:13:15.575874 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 14:13:15.577232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 14:13:15.578803 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:13:15.580437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.580437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.580437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:13:15.580437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.580437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:15.580437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:13:15.580437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:13:15.580437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:13:15.580437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:13:15.580437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.580437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.580437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-ac897ac6-4fa1-4788-a9b9-3b30368ec381 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Returning 404 to user: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. {{(pid=118316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:13:15.580437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-ac897ac6-4fa1-4788-a9b9-3b30368ec381 tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c" status: 404 len: 109 microversion: 2.1 time: 0.036208 Jun 02 14:13:15.580437 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 652/1281] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 2 14:13:15 2022] DELETE /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:13:15.582979 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fa9efaaf-07d4-4be2-a21e-74a10958b15e tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Calling method '.version_select at 0x7fb71ad721f0>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:15.611936 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-fa9efaaf-07d4-4be2-a21e-74a10958b15e tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] HTTP exception thrown: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fa9efaaf-07d4-4be2-a21e-74a10958b15e tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Request method failure captured: Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c HTTP/1.1 Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMVw_VXMQdtvpcHq2WFPkvgU5d7TnLfjPXadnUf2-yA7zYyWpD_CsG_ntmNYJD8N5dVZthgaSIsqlwPuZ9oSB8kmSPUXBVa986kkZe4R9zp8AhenBvdS1ks8kWqOG9PoaUXy_Yh4PmzyHoTZlQWHGrF3oyjdBmY7Kj9gir-ZaqBziUA Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 5a5815cb07604da49ba577304f08f5bc Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-454950069 Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:13:15.613965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:13:15.615740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a5815cb07604da49ba577304f08f5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:13:15.615740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-VolumesSnapshotsTestJSON-454950069 Jun 02 14:13:15.615740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 5a5815cb07604da49ba577304f08f5bc Jun 02 14:13:15.615740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-454950069 Jun 02 14:13:15.615740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-VolumesSnapshotsTestJSON-454950069-project Jun 02 14:13:15.615740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:13:15.615740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:13:15.615740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: 9e0d58651f94465d856d180263884dec Jun 02 14:13:15.615740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-VolumesSnapshotsTestJSON-454950069-project Jun 02 14:13:15.615740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: Jun 02 14:13:15.615740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.615740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c'} Jun 02 14:13:15.615740 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. (HTTP 404) (Request-ID: req-e0a66405-5322-4cb4-b094-d36a163aa439) Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:13:15.616858 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 14:13:15.618505 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 14:13:15.620135 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:13:15.621803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.621803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.621803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:13:15.621803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.621803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:13:15.621803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:13:15.621803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:13:15.621803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:13:15.621803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:13:15.621803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. Jun 02 14:13:15.621803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:13:15.621803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fa9efaaf-07d4-4be2-a21e-74a10958b15e tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] Returning 404 to user: Volume 5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:13:15.621803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-fa9efaaf-07d4-4be2-a21e-74a10958b15e tempest-VolumesSnapshotsTestJSON-454950069 tempest-VolumesSnapshotsTestJSON-454950069-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c" status: 404 len: 109 microversion: 2.1 time: 0.036247 Jun 02 14:13:15.621803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 630/1282] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 2 14:13:15 2022] GET /compute/v2.1/os-volumes/5bed49e5-3782-45f3-b2c4-2c1e1d54aa0c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 14:13:49.814656 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2028607757", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "networks": [{"uuid": "8cbd1074-84c8-4d71-8ca6-e62e8b8bb89c"}]}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:13:49.864684 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.network.neutron [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] validate_networks() for [('8cbd1074-84c8-4d71-8ca6-e62e8b8bb89c', None, None, None, None, None)] {{(pid=118316) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 14:13:50.262661 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Flavor limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 14:13:50.263080 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Image limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 14:13:50.263553 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Flavor pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 14:13:50.263958 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Image pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 14:13:50.264369 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 14:13:50.273138 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:50.273583 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:50.275067 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:50.275439 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:50.292810 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Getting quotas for project 5bbed82f914e4cf0a0b569dca408965b. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:13:50.296773 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Getting quotas for user a5657d98a640416d8dc56291dfd77ad5 and project 5bbed82f914e4cf0a0b569dca408965b. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:13:50.307544 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Going to run 1 instances... {{(pid=118316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 14:13:50.309793 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 14:13:50.441289 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8daaca38-91f2-446a-8ed2-5765b14297f6 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632354 Jun 02 14:13:50.441938 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 653/1283] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 14:13:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 14:13:50.453099 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-fbf3025d-617b-4623-9df5-09e2f50de023 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:50.453721 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-fbf3025d-617b-4623-9df5-09e2f50de023 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:13:50.509479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-fbf3025d-617b-4623-9df5-09e2f50de023 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:13:50.516630 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-fbf3025d-617b-4623-9df5-09e2f50de023 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1214 microversion: 2.1 time: 0.068183 Jun 02 14:13:50.517187 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 631/1284] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:13:50 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:13:51.535510 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-57e2ce2a-aad9-44a8-bdde-877b85744a64 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:51.536099 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-57e2ce2a-aad9-44a8-bdde-877b85744a64 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:13:51.542842 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-57e2ce2a-aad9-44a8-bdde-877b85744a64 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:51.543289 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-57e2ce2a-aad9-44a8-bdde-877b85744a64 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:51.544055 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-57e2ce2a-aad9-44a8-bdde-877b85744a64 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:51.544519 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-57e2ce2a-aad9-44a8-bdde-877b85744a64 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:51.611174 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-57e2ce2a-aad9-44a8-bdde-877b85744a64 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:13:51.619207 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-57e2ce2a-aad9-44a8-bdde-877b85744a64 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1218 microversion: 2.1 time: 0.088660 Jun 02 14:13:51.619780 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 654/1285] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:13:51 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:13:52.636438 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-677000cb-7a58-4405-ba4b-9447229eed18 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:52.637067 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-677000cb-7a58-4405-ba4b-9447229eed18 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:13:52.643619 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-677000cb-7a58-4405-ba4b-9447229eed18 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:52.644070 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-677000cb-7a58-4405-ba4b-9447229eed18 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:52.644905 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-677000cb-7a58-4405-ba4b-9447229eed18 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:52.645343 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-677000cb-7a58-4405-ba4b-9447229eed18 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:52.713091 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-677000cb-7a58-4405-ba4b-9447229eed18 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:13:52.720817 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-677000cb-7a58-4405-ba4b-9447229eed18 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1266 microversion: 2.1 time: 0.088506 Jun 02 14:13:52.730043 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 632/1286] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:13:52 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:13:53.736993 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-207a56ba-317f-43e7-94cd-326259a3ead5 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:53.737628 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-207a56ba-317f-43e7-94cd-326259a3ead5 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:13:53.745426 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-207a56ba-317f-43e7-94cd-326259a3ead5 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:53.745863 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-207a56ba-317f-43e7-94cd-326259a3ead5 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:53.746625 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-207a56ba-317f-43e7-94cd-326259a3ead5 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:53.747050 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-207a56ba-317f-43e7-94cd-326259a3ead5 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:53.888296 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-207a56ba-317f-43e7-94cd-326259a3ead5 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:13:53.895866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-207a56ba-317f-43e7-94cd-326259a3ead5 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1314 microversion: 2.1 time: 0.162879 Jun 02 14:13:53.917427 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 655/1287] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:13:53 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:13:54.848598 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-0299ded4-5889-41df-94b1-006a482b1be6 req-3735d0e8-a9d0-462c-aa3e-01768ba23285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45622352-e364-4521-b205-74fabdbacdb4", "tag": "4b007ec2-ae6d-487a-a052-74687d980179"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:13:54.858106 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-0299ded4-5889-41df-94b1-006a482b1be6 req-3735d0e8-a9d0-462c-aa3e-01768ba23285 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:54.858730 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-0299ded4-5889-41df-94b1-006a482b1be6 req-3735d0e8-a9d0-462c-aa3e-01768ba23285 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:54.872817 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-0299ded4-5889-41df-94b1-006a482b1be6 req-3735d0e8-a9d0-462c-aa3e-01768ba23285 service nova] Creating event network-changed:4b007ec2-ae6d-487a-a052-74687d980179 for instance 45622352-e364-4521-b205-74fabdbacdb4 on hv-cinder-82651 Jun 02 14:13:54.878702 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-0299ded4-5889-41df-94b1-006a482b1be6 req-3735d0e8-a9d0-462c-aa3e-01768ba23285 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033638 Jun 02 14:13:54.881626 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 633/1288] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:13:54.915697 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-06feabfd-8783-4e56-9092-90214cd6244a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:54.916775 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-06feabfd-8783-4e56-9092-90214cd6244a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:13:54.923975 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-06feabfd-8783-4e56-9092-90214cd6244a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:54.924443 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-06feabfd-8783-4e56-9092-90214cd6244a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:54.925219 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-06feabfd-8783-4e56-9092-90214cd6244a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:54.925656 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-06feabfd-8783-4e56-9092-90214cd6244a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:55.058254 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-06feabfd-8783-4e56-9092-90214cd6244a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:13:55.066253 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-06feabfd-8783-4e56-9092-90214cd6244a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1314 microversion: 2.1 time: 0.156340 Jun 02 14:13:55.067037 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 656/1289] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:13:54 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:13:56.084524 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-0c0eb256-d83d-465e-a70d-379cef6562a0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:56.085220 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-0c0eb256-d83d-465e-a70d-379cef6562a0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:13:56.091573 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0c0eb256-d83d-465e-a70d-379cef6562a0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:56.092008 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0c0eb256-d83d-465e-a70d-379cef6562a0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:56.092776 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0c0eb256-d83d-465e-a70d-379cef6562a0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:56.093203 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-0c0eb256-d83d-465e-a70d-379cef6562a0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:56.226917 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-0c0eb256-d83d-465e-a70d-379cef6562a0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:13:56.234471 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-0c0eb256-d83d-465e-a70d-379cef6562a0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1314 microversion: 2.1 time: 0.154737 Jun 02 14:13:56.235038 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 634/1290] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:13:56 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:13:57.250998 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-84115d6b-55d3-4a95-b2d7-a65c51a24e1d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:57.251602 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-84115d6b-55d3-4a95-b2d7-a65c51a24e1d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:13:57.258572 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84115d6b-55d3-4a95-b2d7-a65c51a24e1d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:57.259054 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84115d6b-55d3-4a95-b2d7-a65c51a24e1d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:57.259802 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84115d6b-55d3-4a95-b2d7-a65c51a24e1d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:57.260230 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-84115d6b-55d3-4a95-b2d7-a65c51a24e1d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:57.389375 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-84115d6b-55d3-4a95-b2d7-a65c51a24e1d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:13:57.396923 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-84115d6b-55d3-4a95-b2d7-a65c51a24e1d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1314 microversion: 2.1 time: 0.149827 Jun 02 14:13:57.397476 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 657/1291] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:13:57 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:13:58.414000 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-e9e1a836-dd6c-44b5-b45f-868855c8614d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:58.414793 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-e9e1a836-dd6c-44b5-b45f-868855c8614d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:13:58.421595 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e9e1a836-dd6c-44b5-b45f-868855c8614d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:58.421988 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e9e1a836-dd6c-44b5-b45f-868855c8614d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:58.422815 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e9e1a836-dd6c-44b5-b45f-868855c8614d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:58.423253 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-e9e1a836-dd6c-44b5-b45f-868855c8614d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:58.562138 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-e9e1a836-dd6c-44b5-b45f-868855c8614d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:13:58.569769 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-e9e1a836-dd6c-44b5-b45f-868855c8614d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1314 microversion: 2.1 time: 0.159688 Jun 02 14:13:58.571197 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 635/1292] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:13:58 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:13:59.588180 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-8c0d4110-5372-48f0-ba9a-f11b1faca086 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:13:59.588918 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-8c0d4110-5372-48f0-ba9a-f11b1faca086 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:13:59.600298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8c0d4110-5372-48f0-ba9a-f11b1faca086 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:59.600837 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8c0d4110-5372-48f0-ba9a-f11b1faca086 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:59.601761 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8c0d4110-5372-48f0-ba9a-f11b1faca086 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:13:59.602321 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-8c0d4110-5372-48f0-ba9a-f11b1faca086 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:13:59.730463 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-8c0d4110-5372-48f0-ba9a-f11b1faca086 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:13:59.737811 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-8c0d4110-5372-48f0-ba9a-f11b1faca086 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1314 microversion: 2.1 time: 0.154191 Jun 02 14:13:59.738372 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 658/1293] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:13:59 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:00.445532 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-b271fad7-e885-4775-9fb2-f47d4657771b req-f91e78de-6a52-467f-9e66-5b601224f900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45622352-e364-4521-b205-74fabdbacdb4", "name": "network-vif-plugged", "status": "completed", "tag": "4b007ec2-ae6d-487a-a052-74687d980179"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:14:00.453891 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-b271fad7-e885-4775-9fb2-f47d4657771b req-f91e78de-6a52-467f-9e66-5b601224f900 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:00.454336 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-b271fad7-e885-4775-9fb2-f47d4657771b req-f91e78de-6a52-467f-9e66-5b601224f900 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:00.465214 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-b271fad7-e885-4775-9fb2-f47d4657771b req-f91e78de-6a52-467f-9e66-5b601224f900 service nova] Creating event network-vif-plugged:4b007ec2-ae6d-487a-a052-74687d980179 for instance 45622352-e364-4521-b205-74fabdbacdb4 on hv-cinder-82651 Jun 02 14:14:00.470356 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-b271fad7-e885-4775-9fb2-f47d4657771b req-f91e78de-6a52-467f-9e66-5b601224f900 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028753 Jun 02 14:14:00.470974 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 636/1294] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:14:00.754491 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-856dc852-bbc3-459f-8cb7-f3f8c2590fd8 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:00.755106 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-856dc852-bbc3-459f-8cb7-f3f8c2590fd8 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:00.757009 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:00.757673 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=6 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:00.763712 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-856dc852-bbc3-459f-8cb7-f3f8c2590fd8 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:00.770065 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-856dc852-bbc3-459f-8cb7-f3f8c2590fd8 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:00.770065 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-856dc852-bbc3-459f-8cb7-f3f8c2590fd8 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:00.770065 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-856dc852-bbc3-459f-8cb7-f3f8c2590fd8 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:00.903277 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-856dc852-bbc3-459f-8cb7-f3f8c2590fd8 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:00.911293 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-856dc852-bbc3-459f-8cb7-f3f8c2590fd8 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1314 microversion: 2.1 time: 0.160640 Jun 02 14:14:00.911855 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 659/1295] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:00 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:01.909296 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:14:01.909885 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Thu Jun 2 14:14:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:14:01.925003 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=2 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:01.929627 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-8a11c9cc-6e87-4ce0-b2da-c640dbda30ad tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:01.932282 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-8a11c9cc-6e87-4ce0-b2da-c640dbda30ad tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:01.937360 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8a11c9cc-6e87-4ce0-b2da-c640dbda30ad tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:01.937808 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8a11c9cc-6e87-4ce0-b2da-c640dbda30ad tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:01.938564 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8a11c9cc-6e87-4ce0-b2da-c640dbda30ad tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:01.938999 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-8a11c9cc-6e87-4ce0-b2da-c640dbda30ad tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:02.073564 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-8a11c9cc-6e87-4ce0-b2da-c640dbda30ad tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:02.081051 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-8a11c9cc-6e87-4ce0-b2da-c640dbda30ad tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1314 microversion: 2.1 time: 0.156808 Jun 02 14:14:02.081613 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 637/1296] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:01 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:03.098386 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-a3dd2455-b1fa-4b39-8b14-2575f050109f tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:03.098997 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-a3dd2455-b1fa-4b39-8b14-2575f050109f tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:03.106173 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a3dd2455-b1fa-4b39-8b14-2575f050109f tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:03.106619 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a3dd2455-b1fa-4b39-8b14-2575f050109f tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:03.107380 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a3dd2455-b1fa-4b39-8b14-2575f050109f tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:03.107815 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-a3dd2455-b1fa-4b39-8b14-2575f050109f tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:03.236520 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-a3dd2455-b1fa-4b39-8b14-2575f050109f tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:03.243947 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-a3dd2455-b1fa-4b39-8b14-2575f050109f tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1499 microversion: 2.1 time: 0.149638 Jun 02 14:14:03.244533 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 660/1297] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:03 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1499 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:04.229379 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-deecc76c-2de6-404b-8e64-2d9f954e0576 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:04.229924 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-deecc76c-2de6-404b-8e64-2d9f954e0576 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:04.236318 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-deecc76c-2de6-404b-8e64-2d9f954e0576 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:04.236790 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-deecc76c-2de6-404b-8e64-2d9f954e0576 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:04.237587 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-deecc76c-2de6-404b-8e64-2d9f954e0576 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:04.238016 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-deecc76c-2de6-404b-8e64-2d9f954e0576 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:04.266236 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-deecc76c-2de6-404b-8e64-2d9f954e0576 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Going to try to terminate instance {{(pid=118315) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:14:04.522511 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-deecc76c-2de6-404b-8e64-2d9f954e0576 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 204 len: 0 microversion: 2.1 time: 0.297371 Jun 02 14:14:04.523088 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 638/1298] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:14:04 2022] DELETE /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:14:04.531904 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-4188ef00-5c2d-4af7-badf-611a424a85d0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:04.532549 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-4188ef00-5c2d-4af7-badf-611a424a85d0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:04.538596 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4188ef00-5c2d-4af7-badf-611a424a85d0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:04.539050 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4188ef00-5c2d-4af7-badf-611a424a85d0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:04.540821 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4188ef00-5c2d-4af7-badf-611a424a85d0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:04.541374 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-4188ef00-5c2d-4af7-badf-611a424a85d0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:04.671616 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-4188ef00-5c2d-4af7-badf-611a424a85d0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:04.679069 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-4188ef00-5c2d-4af7-badf-611a424a85d0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1505 microversion: 2.1 time: 0.151198 Jun 02 14:14:04.679641 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 661/1299] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:04 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:05.696890 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-1986f907-4992-4c9e-a0aa-91c0005be2cf tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:05.697589 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-1986f907-4992-4c9e-a0aa-91c0005be2cf tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:05.703974 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1986f907-4992-4c9e-a0aa-91c0005be2cf tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:05.704432 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1986f907-4992-4c9e-a0aa-91c0005be2cf tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:05.705202 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1986f907-4992-4c9e-a0aa-91c0005be2cf tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:05.705631 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-1986f907-4992-4c9e-a0aa-91c0005be2cf tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:05.834049 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-1986f907-4992-4c9e-a0aa-91c0005be2cf tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:05.842195 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-1986f907-4992-4c9e-a0aa-91c0005be2cf tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1505 microversion: 2.1 time: 0.149764 Jun 02 14:14:05.842759 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 639/1300] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:05 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:06.859165 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d74ec39e-e2de-4d91-b95f-f065239de1e7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:06.859888 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d74ec39e-e2de-4d91-b95f-f065239de1e7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:06.866298 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d74ec39e-e2de-4d91-b95f-f065239de1e7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:06.866743 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d74ec39e-e2de-4d91-b95f-f065239de1e7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:06.867512 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d74ec39e-e2de-4d91-b95f-f065239de1e7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:06.867945 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d74ec39e-e2de-4d91-b95f-f065239de1e7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:06.894380 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-c654c4ce-d672-444a-94b0-22b568a892db req-a91fba30-94c7-42a4-a146-92eca79fc899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45622352-e364-4521-b205-74fabdbacdb4", "name": "network-vif-deleted", "tag": "4b007ec2-ae6d-487a-a052-74687d980179"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:14:06.904314 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-c654c4ce-d672-444a-94b0-22b568a892db req-a91fba30-94c7-42a4-a146-92eca79fc899 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:06.905088 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-c654c4ce-d672-444a-94b0-22b568a892db req-a91fba30-94c7-42a4-a146-92eca79fc899 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:06.918235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-c654c4ce-d672-444a-94b0-22b568a892db req-a91fba30-94c7-42a4-a146-92eca79fc899 service nova] Creating event network-vif-deleted:4b007ec2-ae6d-487a-a052-74687d980179 for instance 45622352-e364-4521-b205-74fabdbacdb4 on hv-cinder-82651 Jun 02 14:14:06.923235 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-c654c4ce-d672-444a-94b0-22b568a892db req-a91fba30-94c7-42a4-a146-92eca79fc899 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032450 Jun 02 14:14:06.924108 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 640/1301] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:14:06.955774 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d74ec39e-e2de-4d91-b95f-f065239de1e7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:06.955774 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d74ec39e-e2de-4d91-b95f-f065239de1e7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 200 len: 1463 microversion: 2.1 time: 0.090539 Jun 02 14:14:06.955774 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 662/1302] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:06 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 1463 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:07.964027 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7483ad6e-19cc-4ada-8541-fd24288ed41a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:07.964804 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-7483ad6e-19cc-4ada-8541-fd24288ed41a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 45622352-e364-4521-b205-74fabdbacdb4] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:07.971722 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7483ad6e-19cc-4ada-8541-fd24288ed41a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:07.972158 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7483ad6e-19cc-4ada-8541-fd24288ed41a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:07.972970 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7483ad6e-19cc-4ada-8541-fd24288ed41a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:07.973392 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-7483ad6e-19cc-4ada-8541-fd24288ed41a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:07.987122 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-7483ad6e-19cc-4ada-8541-fd24288ed41a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] HTTP exception thrown: Instance 45622352-e364-4521-b205-74fabdbacdb4 could not be found. Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7483ad6e-19cc-4ada-8541-fd24288ed41a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Request method failure captured: Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 HTTP/1.1 Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMWaIwH-N_RfDVn2lz4rpn4-HnIek7icHoC6A0zMPUTXelscHwp12axKxyrewj4VN_d2iammQ9qAd7AgAS37S2b9jINNDuN10odTbE80Grx3tgl5uJG82Ekep5ukyxxLLXxAH_QAedDnMi5guUqcePamcfT0sgxQpiOCncpBbORSi5I Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 5bbed82f914e4cf0a0b569dca408965b Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-VolumesActionsTest-1702282861 Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:14:07.988935 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:14:07.990831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5bbed82f914e4cf0a0b569dca408965b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bbed82f914e4cf0a0b569dca408965b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bbed82f914e4cf0a0b569dca408965b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5bbed82f914e4cf0a0b569dca408965b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:14:07.990831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-VolumesActionsTest-1702282861 Jun 02 14:14:07.990831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 5bbed82f914e4cf0a0b569dca408965b Jun 02 14:14:07.990831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-VolumesActionsTest-1702282861 Jun 02 14:14:07.990831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-VolumesActionsTest-1702282861-project Jun 02 14:14:07.990831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:14:07.990831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:14:07.990831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: a5657d98a640416d8dc56291dfd77ad5 Jun 02 14:14:07.990831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-VolumesActionsTest-1702282861-project Jun 02 14:14:07.990831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:14:07.990831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance 45622352-e364-4521-b205-74fabdbacdb4 could not be found. Jun 02 14:14:07.990831 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '45622352-e364-4521-b205-74fabdbacdb4'} Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45622352-e364-4521-b205-74fabdbacdb4 could not be found. Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:14:07.991912 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45622352-e364-4521-b205-74fabdbacdb4 could not be found. Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45622352-e364-4521-b205-74fabdbacdb4 could not be found. Jun 02 14:14:07.994402 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:14:07.996044 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-7483ad6e-19cc-4ada-8541-fd24288ed41a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Returning 404 to user: Instance 45622352-e364-4521-b205-74fabdbacdb4 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:14:07.996044 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-7483ad6e-19cc-4ada-8541-fd24288ed41a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4" status: 404 len: 111 microversion: 2.1 time: 0.030861 Jun 02 14:14:07.996044 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 641/1303] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:07 2022] GET /compute/v2.1/servers/45622352-e364-4521-b205-74fabdbacdb4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:14:08.038710 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1381819705", "imageRef": "1f3a67e4-da0a-4f96-9b17-ed885185205a", "flavorRef": "452", "networks": [{"uuid": "8cbd1074-84c8-4d71-8ca6-e62e8b8bb89c"}]}} {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:14:08.089534 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.network.neutron [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] validate_networks() for [('8cbd1074-84c8-4d71-8ca6-e62e8b8bb89c', None, None, None, None, None)] {{(pid=118316) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 14:14:08.438274 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Flavor limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 14:14:08.438698 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Image limits 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 14:14:08.439168 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Flavor pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 14:14:08.439571 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Image pref 0:0:0 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 14:14:08.439976 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.virt.hardware [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 14:14:08.449242 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:08.449686 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:08.450471 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:08.450899 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:08.467344 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Getting quotas for project 5bbed82f914e4cf0a0b569dca408965b. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 14:14:08.471029 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.quota [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Getting quotas for user a5657d98a640416d8dc56291dfd77ad5 and project 5bbed82f914e4cf0a0b569dca408965b. Resources: {'instances', 'ram', 'cores'} {{(pid=118316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 14:14:08.482387 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Going to run 1 instances... {{(pid=118316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 14:14:08.484507 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1f3a67e4-da0a-4f96-9b17-ed885185205a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 14:14:08.599321 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-97a0b757-3495-4c76-a6ef-3f298f6d4301 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564393 Jun 02 14:14:08.599983 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 663/1304] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 2 14:14:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 14:14:08.611634 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-afa1156b-65a1-4c78-90ff-1b427d0259c3 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:08.612300 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-afa1156b-65a1-4c78-90ff-1b427d0259c3 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:08.670142 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-afa1156b-65a1-4c78-90ff-1b427d0259c3 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:08.678214 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-afa1156b-65a1-4c78-90ff-1b427d0259c3 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1214 microversion: 2.1 time: 0.070033 Jun 02 14:14:08.678789 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 642/1305] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:08 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:09.696699 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-1c22e2e3-1cf7-4d8f-b063-b53f1f2d7c3b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:09.697460 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-1c22e2e3-1cf7-4d8f-b063-b53f1f2d7c3b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:09.704035 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1c22e2e3-1cf7-4d8f-b063-b53f1f2d7c3b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:09.704533 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1c22e2e3-1cf7-4d8f-b063-b53f1f2d7c3b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:09.705287 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1c22e2e3-1cf7-4d8f-b063-b53f1f2d7c3b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:09.705723 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1c22e2e3-1cf7-4d8f-b063-b53f1f2d7c3b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:09.767709 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1c22e2e3-1cf7-4d8f-b063-b53f1f2d7c3b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:09.775228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-1c22e2e3-1cf7-4d8f-b063-b53f1f2d7c3b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1218 microversion: 2.1 time: 0.082985 Jun 02 14:14:09.779710 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 664/1306] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:09 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:10.791321 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-9fe386c7-ce1c-4d08-9c7a-f29cd650d85c tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:10.791978 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-9fe386c7-ce1c-4d08-9c7a-f29cd650d85c tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:10.799428 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9fe386c7-ce1c-4d08-9c7a-f29cd650d85c tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:10.799871 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9fe386c7-ce1c-4d08-9c7a-f29cd650d85c tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:10.800657 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9fe386c7-ce1c-4d08-9c7a-f29cd650d85c tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:10.801087 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-9fe386c7-ce1c-4d08-9c7a-f29cd650d85c tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:10.978653 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-9fe386c7-ce1c-4d08-9c7a-f29cd650d85c tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:10.989378 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-9fe386c7-ce1c-4d08-9c7a-f29cd650d85c tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1274 microversion: 2.1 time: 0.201873 Jun 02 14:14:10.990042 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 643/1307] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:10 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:12.007498 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-c6332d2f-d4b2-4448-b1e4-b4644ecd0f78 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:12.008394 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-c6332d2f-d4b2-4448-b1e4-b4644ecd0f78 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:12.015207 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6332d2f-d4b2-4448-b1e4-b4644ecd0f78 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:12.015657 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6332d2f-d4b2-4448-b1e4-b4644ecd0f78 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:12.016429 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6332d2f-d4b2-4448-b1e4-b4644ecd0f78 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:12.016968 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-c6332d2f-d4b2-4448-b1e4-b4644ecd0f78 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:12.200922 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-c6332d2f-d4b2-4448-b1e4-b4644ecd0f78 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:12.208275 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-c6332d2f-d4b2-4448-b1e4-b4644ecd0f78 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1314 microversion: 2.1 time: 0.204684 Jun 02 14:14:12.208866 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 665/1308] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:12 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:14:12.338664 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-fb05cb3f-0d45-468c-b8c7-5f77050c6372 req-21db845a-312d-4de4-8847-a404a9f69b16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0ba14d-55a7-4be8-a34a-8f32a42cab89", "tag": "c640d292-1a28-4fdf-81e7-2524c6ea909a"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:14:12.348231 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-fb05cb3f-0d45-468c-b8c7-5f77050c6372 req-21db845a-312d-4de4-8847-a404a9f69b16 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:12.349406 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-fb05cb3f-0d45-468c-b8c7-5f77050c6372 req-21db845a-312d-4de4-8847-a404a9f69b16 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:12.361253 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-fb05cb3f-0d45-468c-b8c7-5f77050c6372 req-21db845a-312d-4de4-8847-a404a9f69b16 service nova] Creating event network-changed:c640d292-1a28-4fdf-81e7-2524c6ea909a for instance 0d0ba14d-55a7-4be8-a34a-8f32a42cab89 on hv-cinder-82651 Jun 02 14:14:12.366052 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-fb05cb3f-0d45-468c-b8c7-5f77050c6372 req-21db845a-312d-4de4-8847-a404a9f69b16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032114 Jun 02 14:14:12.366821 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 644/1309] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:14:13.224714 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7ed73b49-d7e1-4499-b9f3-60f2c5bbb4b4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:13.225386 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7ed73b49-d7e1-4499-b9f3-60f2c5bbb4b4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:13.231781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ed73b49-d7e1-4499-b9f3-60f2c5bbb4b4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:13.232232 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ed73b49-d7e1-4499-b9f3-60f2c5bbb4b4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:13.233018 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ed73b49-d7e1-4499-b9f3-60f2c5bbb4b4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:13.233438 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7ed73b49-d7e1-4499-b9f3-60f2c5bbb4b4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:13.361987 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7ed73b49-d7e1-4499-b9f3-60f2c5bbb4b4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:13.369417 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7ed73b49-d7e1-4499-b9f3-60f2c5bbb4b4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1314 microversion: 2.1 time: 0.148721 Jun 02 14:14:13.369982 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 666/1310] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:13 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:14.389322 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-48237f3a-d517-419a-b5f2-65da9a6dc47a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:14.390028 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-48237f3a-d517-419a-b5f2-65da9a6dc47a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:14.396707 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-48237f3a-d517-419a-b5f2-65da9a6dc47a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:14.397154 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-48237f3a-d517-419a-b5f2-65da9a6dc47a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:14.397910 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-48237f3a-d517-419a-b5f2-65da9a6dc47a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:14.398340 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-48237f3a-d517-419a-b5f2-65da9a6dc47a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:14.525442 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-48237f3a-d517-419a-b5f2-65da9a6dc47a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:14.533250 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-48237f3a-d517-419a-b5f2-65da9a6dc47a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1314 microversion: 2.1 time: 0.148528 Jun 02 14:14:14.533809 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 645/1311] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:14 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:15.550188 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-25cfa9e3-2fdf-4816-950e-49322483f360 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:15.550793 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-25cfa9e3-2fdf-4816-950e-49322483f360 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:15.557290 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-25cfa9e3-2fdf-4816-950e-49322483f360 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:15.557730 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-25cfa9e3-2fdf-4816-950e-49322483f360 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:15.558471 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-25cfa9e3-2fdf-4816-950e-49322483f360 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:15.558893 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-25cfa9e3-2fdf-4816-950e-49322483f360 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:15.691947 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-25cfa9e3-2fdf-4816-950e-49322483f360 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:15.699373 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-25cfa9e3-2fdf-4816-950e-49322483f360 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1314 microversion: 2.1 time: 0.153070 Jun 02 14:14:15.699944 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 667/1312] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:15 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:14:16.716232 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-df002c57-433d-4190-a8c1-d2e80fbc9b8b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:16.717021 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-df002c57-433d-4190-a8c1-d2e80fbc9b8b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:16.724927 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-df002c57-433d-4190-a8c1-d2e80fbc9b8b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:16.725370 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-df002c57-433d-4190-a8c1-d2e80fbc9b8b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:16.726127 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-df002c57-433d-4190-a8c1-d2e80fbc9b8b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:16.726556 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-df002c57-433d-4190-a8c1-d2e80fbc9b8b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:16.854791 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-df002c57-433d-4190-a8c1-d2e80fbc9b8b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:16.863348 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-df002c57-433d-4190-a8c1-d2e80fbc9b8b tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1314 microversion: 2.1 time: 0.150978 Jun 02 14:14:16.866405 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 646/1313] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:16 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:17.880395 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-d6d86c9d-6b4e-4eee-a8a4-1c007b2143d7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:17.881013 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-d6d86c9d-6b4e-4eee-a8a4-1c007b2143d7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:17.887605 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6d86c9d-6b4e-4eee-a8a4-1c007b2143d7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:17.888068 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6d86c9d-6b4e-4eee-a8a4-1c007b2143d7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:17.895071 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6d86c9d-6b4e-4eee-a8a4-1c007b2143d7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:17.895071 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-d6d86c9d-6b4e-4eee-a8a4-1c007b2143d7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:18.018247 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-d6d86c9d-6b4e-4eee-a8a4-1c007b2143d7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:18.025661 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-d6d86c9d-6b4e-4eee-a8a4-1c007b2143d7 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1314 microversion: 2.1 time: 0.149142 Jun 02 14:14:18.026229 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 668/1314] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:17 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:18.512217 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-2b36420c-e19a-4ba6-ad4e-ba80d7b3186c req-0c355eab-4f22-4ff4-b5df-54d93a2c8173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0ba14d-55a7-4be8-a34a-8f32a42cab89", "name": "network-vif-plugged", "status": "completed", "tag": "c640d292-1a28-4fdf-81e7-2524c6ea909a"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:14:18.521834 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-2b36420c-e19a-4ba6-ad4e-ba80d7b3186c req-0c355eab-4f22-4ff4-b5df-54d93a2c8173 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:18.522291 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-2b36420c-e19a-4ba6-ad4e-ba80d7b3186c req-0c355eab-4f22-4ff4-b5df-54d93a2c8173 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:18.533390 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-2b36420c-e19a-4ba6-ad4e-ba80d7b3186c req-0c355eab-4f22-4ff4-b5df-54d93a2c8173 service nova] Creating event network-vif-plugged:c640d292-1a28-4fdf-81e7-2524c6ea909a for instance 0d0ba14d-55a7-4be8-a34a-8f32a42cab89 on hv-cinder-82651 Jun 02 14:14:18.538336 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-2b36420c-e19a-4ba6-ad4e-ba80d7b3186c req-0c355eab-4f22-4ff4-b5df-54d93a2c8173 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029666 Jun 02 14:14:18.538924 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 647/1315] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 14:14:19.042464 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-1b7e96f6-45d1-46ac-bba3-5bbd9f95799a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:19.043076 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-1b7e96f6-45d1-46ac-bba3-5bbd9f95799a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:19.045502 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=2 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:19.046323 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell0:SELECT=6 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:19.051513 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1b7e96f6-45d1-46ac-bba3-5bbd9f95799a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:19.051957 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1b7e96f6-45d1-46ac-bba3-5bbd9f95799a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:19.052732 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1b7e96f6-45d1-46ac-bba3-5bbd9f95799a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:19.053163 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-1b7e96f6-45d1-46ac-bba3-5bbd9f95799a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:19.185960 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-1b7e96f6-45d1-46ac-bba3-5bbd9f95799a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:19.193397 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-1b7e96f6-45d1-46ac-bba3-5bbd9f95799a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1314 microversion: 2.1 time: 0.154791 Jun 02 14:14:19.194065 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 669/1316] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:19 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:20.211304 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-ebaa4c32-b3ea-4cc4-895b-1531a0554f5d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:20.211998 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-ebaa4c32-b3ea-4cc4-895b-1531a0554f5d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:20.214166 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell0:SELECT=2 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:20.220988 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ebaa4c32-b3ea-4cc4-895b-1531a0554f5d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:20.221428 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ebaa4c32-b3ea-4cc4-895b-1531a0554f5d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:20.222182 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ebaa4c32-b3ea-4cc4-895b-1531a0554f5d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:20.222606 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-ebaa4c32-b3ea-4cc4-895b-1531a0554f5d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:20.375284 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-ebaa4c32-b3ea-4cc4-895b-1531a0554f5d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:20.382996 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-ebaa4c32-b3ea-4cc4-895b-1531a0554f5d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1314 microversion: 2.1 time: 0.177252 Jun 02 14:14:20.383561 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 648/1317] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:20 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:21.400536 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-bb50ade3-99c8-4548-8e30-bdf9f2f7d1fb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:21.401149 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-bb50ade3-99c8-4548-8e30-bdf9f2f7d1fb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:21.404016 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:21.409912 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bb50ade3-99c8-4548-8e30-bdf9f2f7d1fb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:21.410360 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bb50ade3-99c8-4548-8e30-bdf9f2f7d1fb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:21.411132 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bb50ade3-99c8-4548-8e30-bdf9f2f7d1fb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:21.411606 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-bb50ade3-99c8-4548-8e30-bdf9f2f7d1fb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:21.414190 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG dbcounter [-] [118316] Writing DB stats nova_cell1:SELECT=95 {{(pid=118316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:21.545386 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-bb50ade3-99c8-4548-8e30-bdf9f2f7d1fb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:21.552659 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-bb50ade3-99c8-4548-8e30-bdf9f2f7d1fb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1498 microversion: 2.1 time: 0.156055 Jun 02 14:14:21.553228 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 670/1318] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:21 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:22.395558 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-dff659e6-0b96-4039-81de-6f30d4161e5a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:22.396150 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-dff659e6-0b96-4039-81de-6f30d4161e5a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:22.398531 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:22.403286 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dff659e6-0b96-4039-81de-6f30d4161e5a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:22.403736 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dff659e6-0b96-4039-81de-6f30d4161e5a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:22.405161 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dff659e6-0b96-4039-81de-6f30d4161e5a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:22.405593 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-dff659e6-0b96-4039-81de-6f30d4161e5a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:22.410614 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG dbcounter [-] [118315] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:22.430660 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-dff659e6-0b96-4039-81de-6f30d4161e5a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Going to try to terminate instance {{(pid=118315) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 14:14:22.764066 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-dff659e6-0b96-4039-81de-6f30d4161e5a tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 204 len: 0 microversion: 2.1 time: 0.371657 Jun 02 14:14:22.764713 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 649/1319] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 2 14:14:22 2022] DELETE /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 14:14:22.772946 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-7c2bb15c-07bb-42ec-8277-1e8252a626d4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:22.773565 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-7c2bb15c-07bb-42ec-8277-1e8252a626d4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:22.780736 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7c2bb15c-07bb-42ec-8277-1e8252a626d4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:22.781183 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7c2bb15c-07bb-42ec-8277-1e8252a626d4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:22.781939 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7c2bb15c-07bb-42ec-8277-1e8252a626d4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:22.782402 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-7c2bb15c-07bb-42ec-8277-1e8252a626d4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:22.911498 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-7c2bb15c-07bb-42ec-8277-1e8252a626d4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:22.919277 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-7c2bb15c-07bb-42ec-8277-1e8252a626d4 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1504 microversion: 2.1 time: 0.150187 Jun 02 14:14:22.919900 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 671/1320] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:22 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:23.938457 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-4b76652c-d91e-4237-bf68-2686c77f7deb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:23.939101 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-4b76652c-d91e-4237-bf68-2686c77f7deb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:23.945745 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4b76652c-d91e-4237-bf68-2686c77f7deb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:23.946202 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4b76652c-d91e-4237-bf68-2686c77f7deb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:23.946971 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4b76652c-d91e-4237-bf68-2686c77f7deb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:23.947406 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-4b76652c-d91e-4237-bf68-2686c77f7deb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:24.081965 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.policy [None req-4b76652c-d91e-4237-bf68-2686c77f7deb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118315) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:24.089496 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-4b76652c-d91e-4237-bf68-2686c77f7deb tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1504 microversion: 2.1 time: 0.156808 Jun 02 14:14:24.090055 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 650/1321] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:23 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:25.108682 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-f8692b4d-cd1b-43eb-bc68-c6b814095682 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:25.109089 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-f8692b4d-cd1b-43eb-bc68-c6b814095682 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:25.115822 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f8692b4d-cd1b-43eb-bc68-c6b814095682 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:25.116433 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f8692b4d-cd1b-43eb-bc68-c6b814095682 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:25.119292 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f8692b4d-cd1b-43eb-bc68-c6b814095682 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:25.119292 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-f8692b4d-cd1b-43eb-bc68-c6b814095682 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:25.169354 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [req-3c59e7c8-b40e-46eb-9eac-dd6db50521ab req-784e730b-6a88-4925-ac0f-298f7a8579e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0ba14d-55a7-4be8-a34a-8f32a42cab89", "name": "network-vif-deleted", "tag": "c640d292-1a28-4fdf-81e7-2524c6ea909a"}]} {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 14:14:25.177899 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-3c59e7c8-b40e-46eb-9eac-dd6db50521ab req-784e730b-6a88-4925-ac0f-298f7a8579e5 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:25.182484 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [req-3c59e7c8-b40e-46eb-9eac-dd6db50521ab req-784e730b-6a88-4925-ac0f-298f7a8579e5 service nova] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:25.186270 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-f8692b4d-cd1b-43eb-bc68-c6b814095682 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:25.190469 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.compute.server_external_events [req-3c59e7c8-b40e-46eb-9eac-dd6db50521ab req-784e730b-6a88-4925-ac0f-298f7a8579e5 service nova] Creating event network-vif-deleted:c640d292-1a28-4fdf-81e7-2524c6ea909a for instance 0d0ba14d-55a7-4be8-a34a-8f32a42cab89 on hv-cinder-82651 Jun 02 14:14:25.193964 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-f8692b4d-cd1b-43eb-bc68-c6b814095682 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1462 microversion: 2.1 time: 0.090954 Jun 02 14:14:25.194546 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 672/1322] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:25 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1462 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 14:14:25.195552 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [req-3c59e7c8-b40e-46eb-9eac-dd6db50521ab req-784e730b-6a88-4925-ac0f-298f7a8579e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029978 Jun 02 14:14:25.196151 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 651/1323] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 2 14:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 14:14:26.211532 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.api.openstack.wsgi [None req-27b62082-f570-4c56-bca0-84e9553166f0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:26.217390 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.compute.api [None req-27b62082-f570-4c56-bca0-84e9553166f0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:26.219147 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-27b62082-f570-4c56-bca0-84e9553166f0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:26.219584 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-27b62082-f570-4c56-bca0-84e9553166f0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:26.220326 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-27b62082-f570-4c56-bca0-84e9553166f0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:26.220781 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-27b62082-f570-4c56-bca0-84e9553166f0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:26.252002 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-27b62082-f570-4c56-bca0-84e9553166f0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:26.252461 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG oslo_concurrency.lockutils [None req-27b62082-f570-4c56-bca0-84e9553166f0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:26.252926 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.objects.instance [None req-27b62082-f570-4c56-bca0-84e9553166f0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lazy-loading 'fault' on Instance uuid 0d0ba14d-55a7-4be8-a34a-8f32a42cab89 {{(pid=118316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 14:14:26.294020 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: DEBUG nova.policy [None req-27b62082-f570-4c56-bca0-84e9553166f0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5657d98a640416d8dc56291dfd77ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbed82f914e4cf0a0b569dca408965b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 14:14:26.301558 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO nova.api.openstack.requestlog [None req-27b62082-f570-4c56-bca0-84e9553166f0 tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 200 len: 1304 microversion: 2.1 time: 0.093894 Jun 02 14:14:26.302118 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: [pid: 118316|app: 0|req: 673/1324] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:26 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 14:14:27.320078 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a66b11f7-bd94-4858-ae08-f5f93a0e747d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Calling method '>' {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 14:14:27.320803 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.compute.api [None req-a66b11f7-bd94-4858-ae08-f5f93a0e747d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] [instance: 0d0ba14d-55a7-4be8-a34a-8f32a42cab89] Fetching instance by UUID {{(pid=118315) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 14:14:27.327153 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a66b11f7-bd94-4858-ae08-f5f93a0e747d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:27.327665 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a66b11f7-bd94-4858-ae08-f5f93a0e747d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:27.328479 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a66b11f7-bd94-4858-ae08-f5f93a0e747d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 14:14:27.328926 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG oslo_concurrency.lockutils [None req-a66b11f7-bd94-4858-ae08-f5f93a0e747d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Lock "b23e70ef-c1f8-4cdc-b345-bb99123a3df5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 14:14:27.342260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.wsgi [None req-a66b11f7-bd94-4858-ae08-f5f93a0e747d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] HTTP exception thrown: Instance 0d0ba14d-55a7-4be8-a34a-8f32a42cab89 could not be found. Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a66b11f7-bd94-4858-ae08-f5f93a0e747d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Request method failure captured: Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: request: GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 HTTP/1.1 Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept: application/json Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Accept-Encoding: identity Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Connection: close Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Length: 0 Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Content-Type: application/json Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Host: 10.222.0.33 Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Openstack-System-Scope: None Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: User-Agent: python-urllib3/1.26.9 Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Auth-Token: gAAAAABimMWaIwH-N_RfDVn2lz4rpn4-HnIek7icHoC6A0zMPUTXelscHwp12axKxyrewj4VN_d2iammQ9qAd7AgAS37S2b9jINNDuN10odTbE80Grx3tgl5uJG82Ekep5ukyxxLLXxAH_QAedDnMi5guUqcePamcfT0sgxQpiOCncpBbORSi5I Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Id: None Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Domain-Name: None Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Identity-Status: Confirmed Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Is-Admin-Project: True Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Id: default Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Domain-Name: Default Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Id: 5bbed82f914e4cf0a0b569dca408965b Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Project-Name: tempest-VolumesActionsTest-1702282861 Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Role: reader,member Jun 02 14:14:27.344312 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Roles: reader,member Jun 02 14:14:27.346225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5bbed82f914e4cf0a0b569dca408965b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bbed82f914e4cf0a0b569dca408965b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bbed82f914e4cf0a0b569dca408965b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5bbed82f914e4cf0a0b569dca408965b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 02 14:14:27.346225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant: tempest-VolumesActionsTest-1702282861 Jun 02 14:14:27.346225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Id: 5bbed82f914e4cf0a0b569dca408965b Jun 02 14:14:27.346225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-Tenant-Name: tempest-VolumesActionsTest-1702282861 Jun 02 14:14:27.346225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User: tempest-VolumesActionsTest-1702282861-project Jun 02 14:14:27.346225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Id: default Jun 02 14:14:27.346225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Domain-Name: Default Jun 02 14:14:27.346225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Id: a5657d98a640416d8dc56291dfd77ad5 Jun 02 14:14:27.346225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: X-User-Name: tempest-VolumesActionsTest-1702282861-project Jun 02 14:14:27.346225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: method: > Jun 02 14:14:27.346225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: exception: Instance 0d0ba14d-55a7-4be8-a34a-8f32a42cab89 could not be found. Jun 02 14:14:27.346225 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: action_args: {'id': '0d0ba14d-55a7-4be8-a34a-8f32a42cab89'} Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: {{(pid=118315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0ba14d-55a7-4be8-a34a-8f32a42cab89 could not be found. Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 14:14:27.347260 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0ba14d-55a7-4be8-a34a-8f32a42cab89 could not be found. Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0ba14d-55a7-4be8-a34a-8f32a42cab89 could not be found. Jun 02 14:14:27.349013 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: ERROR nova.api.openstack.wsgi Jun 02 14:14:27.350614 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: DEBUG nova.api.openstack.wsgi [None req-a66b11f7-bd94-4858-ae08-f5f93a0e747d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] Returning 404 to user: Instance 0d0ba14d-55a7-4be8-a34a-8f32a42cab89 could not be found. {{(pid=118315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 14:14:27.350614 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO nova.api.openstack.requestlog [None req-a66b11f7-bd94-4858-ae08-f5f93a0e747d tempest-VolumesActionsTest-1702282861 tempest-VolumesActionsTest-1702282861-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89" status: 404 len: 111 microversion: 2.1 time: 0.030418 Jun 02 14:14:27.350614 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: [pid: 118315|app: 0|req: 652/1325] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 2 14:14:27 2022] GET /compute/v2.1/servers/0d0ba14d-55a7-4be8-a34a-8f32a42cab89 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 14:15:43.049140 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:15:43.049796 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Thu Jun 2 14:15:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:15:57.938383 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:15:57.939113 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Thu Jun 2 14:15:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:16:31.872037 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:16:31.872651 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Thu Jun 2 14:16:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:17:21.918679 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:17:21.919380 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Thu Jun 2 14:17:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:17:37.405632 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:17:37.406381 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Thu Jun 2 14:17:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:19:03.057833 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:19:03.058668 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Thu Jun 2 14:19:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:19:17.947542 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:19:17.948293 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Thu Jun 2 14:19:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:19:31.540251 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:19:31.540869 dv-cinder-826510-6-iscsi devstack@n-api.service[118316]: Thu Jun 2 14:19:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 14:19:51.880214 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 14:19:51.880829 dv-cinder-826510-6-iscsi devstack@n-api.service[118315]: Thu Jun 2 14:19:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!